Sep 10 15:05:39 devstack cinder-volume[75016]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75016) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 10 15:05:39 devstack cinder-volume[75016]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75016) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 10 15:05:39 devstack cinder-volume[75016]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75016) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 10 15:05:40 devstack cinder-volume[75016]: INFO dbcounter [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Registered counter for database cinder Sep 10 15:05:40 devstack cinder-volume[75016]: DEBUG oslo_db.sqlalchemy.engines [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75016) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 15:05:41 devstack cinder-volume[75016]: DEBUG dbcounter [-] [75016] Writer thread running {{(pid=75016) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 10 15:05:41 devstack cinder-volume[75016]: INFO cinder.rpc [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 10 15:05:41 devstack cinder-volume[75016]: INFO cinder.rpc [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 10 15:05:41 devstack cinder-volume[75016]: DEBUG oslo_db.sqlalchemy.engines [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75016) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 15:05:41 devstack cinder-volume[75016]: INFO cinder.volume.manager [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Determined volume DB was empty at startup. Sep 10 15:05:41 devstack cinder-volume[75016]: DEBUG cinder.volume.manager [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75016) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 10 15:05:41 devstack cinder-volume[75016]: INFO cinder.volume.manager [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 10 15:05:41 devstack cinder-volume[75016]: WARNING stevedore.named [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 15:05:41 devstack cinder-volume[75016]: WARNING castellan.key_manager [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 15:05:41 devstack cinder-volume[75016]: WARNING cinder.keymgr.conf_key_mgr [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 15:05:41 devstack cinder-volume[75016]: DEBUG cinder.volume.drivers.lvm [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75016) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Sep 10 15:05:41 devstack cinder-volume[75016]: DEBUG oslo_concurrency.processutils [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:05:42 devstack cinder-volume[75016]: DEBUG oslo_concurrency.processutils [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] CMD "cinder-rtstool verify" returned: 0 in 1.031s {{(pid=75016) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:05:42 devstack cinder-volume[75016]: DEBUG oslo_db.sqlalchemy.engines [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75016) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 15:05:42 devstack cinder-volume[75016]: INFO cinder.rpc [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 10 15:05:42 devstack cinder-volume[75016]: INFO cinder.rpc [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 10 15:05:42 devstack cinder-volume[75016]: WARNING stevedore.named [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 15:05:42 devstack cinder-volume[75016]: WARNING castellan.key_manager [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 15:05:42 devstack cinder-volume[75016]: INFO cinder.volume.manager [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 10 15:05:42 devstack cinder-volume[75016]: DEBUG oslo_db.sqlalchemy.engines [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75016) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 15:05:43 devstack cinder-volume[75016]: INFO oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Starting 1 workers Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Started child 75170 {{(pid=75016) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Full set of CONF: {{(pid=75016) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] ******************************************************************************** {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Configuration options gathered from: {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] ================================================================================ {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] allow_availability_zone_fallback = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] allow_compression_on_image_upload = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] allowed_direct_url_schemes = [] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] api_rate_limit = True {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] auth_strategy = keystone {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] az_cache_duration = 3600 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_availability_zone = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_host = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_name = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_stats_polling_interval = 60 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75170]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0) Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backup_api_class = cinder.backup.api.API {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backup_name_template = backup-%s {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backup_use_same_host = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backup_use_temp_snapshot = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] chap_password = **** {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] chap_username = {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cinder_internal_tenant_project_id = c8021a5588794091aab8a967b3c45985 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cinder_internal_tenant_user_id = 826588877da047428a583411702258d5 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cloned_volume_same_az = True {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cluster = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] compression_format = gzip {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] compute_api_class = cinder.compute.nova.API {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] config_dir = [] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] config_source = [] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] control_exchange = openstack {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] debug = True {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] default_availability_zone = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] default_group_type = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] default_volume_type = lvmdriver-1 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] driver_client_cert = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] driver_client_cert_key = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] driver_data_namespace = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] driver_ssl_cert_path = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] driver_ssl_cert_verify = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] driver_use_ssl = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] enable_force_upload = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] enable_new_services = True {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] enable_unsupported_driver = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] enforce_multipath_for_image_xfer = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] filter_function = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] glance_api_insecure = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] glance_api_servers = ['http://192.168.122.60/image'] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] glance_api_ssl_compression = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] glance_ca_certificates_file = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] glance_catalog_info = image:glance:publicURL {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] glance_certfile = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] glance_keyfile = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] glance_num_retries = 3 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] glance_request_timeout = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] goodness_function = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] graceful_shutdown_timeout = 5 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] group_api_class = cinder.group.api.API {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] host = devstack {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] image_compress_on_upload = True {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] image_conversion_address_space_limit = 1 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] image_conversion_cpu_limit = 60 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] image_conversion_disable = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] image_upload_use_cinder_backend = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] image_upload_use_internal_tenant = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] image_volume_cache_enabled = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] image_volume_cache_max_count = 0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] image_volume_cache_max_size_gb = 0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] init_host_max_objects_retrieval = 0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] instance_format = [instance: %(uuid)s] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] iscsi_iotype = fileio {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] iscsi_target_flags = {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] iscsi_write_cache = on {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] iser_helper = tgtadm {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] iser_ip_address = 192.168.122.60 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] iser_port = 3260 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] log_color = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] log_config_append = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] log_dir = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] log_file = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] log_options = True {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] log_rotate_interval = 1 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] log_rotate_interval_type = days {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] log_rotation_type = none {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] max_age = 0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] max_logfile_count = 30 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] max_logfile_size_mb = 200 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] max_over_subscription_ratio = 20.0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] message_reap_interval = 86400 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] message_ttl = 2592000 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] migration_create_volume_timeout_secs = 300 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] monkey_patch = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] monkey_patch_modules = [] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] my_ip = 192.168.122.60 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] no_snapshot_gb_quota = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] num_iser_scan_tries = 3 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] num_shell_tries = 3 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] num_volume_device_scan_tries = 3 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] nvmeof_conn_info_version = 1 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] nvmet_ns_id = 10 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] nvmet_port_id = 1 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] osapi_max_limit = 1000 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] osapi_volume_ext_list = [] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] osapi_volume_listen_port = 8776 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] osapi_volume_use_ssl = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] osapi_volume_workers = 2 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] per_volume_size_limit = -1 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] periodic_fuzzy_delay = 60 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] periodic_interval = 60 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] public_endpoint = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] publish_errors = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] quota_backup_gigabytes = 1000 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] quota_backups = 10 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] quota_gigabytes = 1000 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] quota_groups = 10 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] quota_snapshots = 10 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] quota_volumes = 10 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] rate_limit_burst = 0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] rate_limit_except_level = CRITICAL {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] rate_limit_interval = 0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] reinit_driver_count = 3 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] replication_device = **** {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] report_discard_supported = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] report_interval = 120 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] reservation_clean_interval = 86400 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] reservation_expire = 86400 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] reserved_image_namespaces = [] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] reserved_percentage = 0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] rpc_response_timeout = 120 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] run_external_periodic_tasks = True {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] scst_target_driver = iscsi {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] scst_target_iqn_name = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] service_down_time = 720 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] shell_completion = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] snapshot_name_template = snapshot-%s {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] snapshot_same_host = True {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] split_loggers = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] state_path = /opt/stack/data/cinder {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] storage_availability_zone = nova {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] storage_protocol = iSCSI {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] syslog_log_facility = LOG_USER {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] target_helper = lioadm {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] target_ip_address = 192.168.122.60 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] target_port = 3260 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] target_protocol = iscsi {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] target_secondary_ip_addresses = [] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] trace_flags = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] transport_url = **** {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] until_refresh = 0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] use_chap_auth = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] use_default_quota_class = True {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] use_journal = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] use_json = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] use_multipath_for_image_xfer = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] use_stderr = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] use_syslog = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] verify_glance_signatures = enabled {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] volume_api_class = cinder.volume.api.API {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] volume_backend_name = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] volume_clear = zero {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] volume_clear_ionice = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] volume_clear_size = 0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] volume_copy_bps_limit = 0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] volume_dd_blocksize = 1M {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] volume_name_template = volume-%s {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] volume_service_inithost_offload = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] volume_usage_audit_period = month {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] watch_log_file = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] zoning_mode = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_concurrency.disable_process_locking = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.admin_password = **** {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.admin_token = **** {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.admin_user = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.auth_admin_prefix = {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.auth_port = 35357 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.auth_protocol = https {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.auth_section = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.auth_type = password {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.auth_uri = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.auth_version = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.cache = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.certfile = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.identity_uri = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.include_service_catalog = True {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.insecure = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.interface = public {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.keyfile = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.memcache_password = {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.memcache_username = {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.region_name = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.service_type = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.backend = dogpile.cache.null {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.backend_argument = **** {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.backend_expiration_time = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.config_prefix = cache.oslo {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.dead_timeout = 60.0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.debug_cache_backend = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.enable_retry_client = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.enable_socket_keepalive = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.enabled = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.enforce_fips_mode = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.expiration_time = 600 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.hashclient_retry_attempts = 2 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.hashclient_retry_delay = 1.0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.memcache_dead_retry = 300 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.memcache_password = **** {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.memcache_pool_maxsize = 10 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.memcache_sasl_enabled = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.memcache_socket_timeout = 1.0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.memcache_username = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.proxies = [] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.redis_db = 0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.redis_password = **** {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.redis_server = localhost:6379 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.redis_socket_timeout = 1.0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.redis_username = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.retry_attempts = 2 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.retry_delay = 0.0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.socket_keepalive_count = 1 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.socket_keepalive_idle = 1 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.socket_keepalive_interval = 1 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.tls_allowed_ciphers = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.tls_cafile = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.tls_certfile = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.tls_enabled = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cache.tls_keyfile = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] coordination.backend_url = **** {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] database.asyncio_connection = **** {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] database.asyncio_slave_connection = **** {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] database.backend = sqlalchemy {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] database.connection = **** {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] database.connection_debug = 0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] database.connection_parameters = {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] database.connection_recycle_time = 3600 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] database.connection_trace = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] database.db_inc_retry_interval = True {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] database.db_max_retries = 20 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] database.db_max_retry_interval = 10 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] database.db_retry_interval = 1 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] database.max_overflow = 50 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] database.max_pool_size = 5 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] database.max_retries = 10 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] database.mysql_wsrep_sync_wait = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] database.pool_timeout = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] database.retry_interval = 10 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] database.slave_connection = **** {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] database.sqlite_synchronous = True {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] database.use_db_reconnect = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] profiler.connection_string = messaging:// {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] profiler.enabled = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] profiler.es_doc_type = notification {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] profiler.es_scroll_size = 10000 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] profiler.es_scroll_time = 2m {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] profiler.filter_error_trace = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] profiler.hmac_keys = **** {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75170]: INFO cinder.volume.manager [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] profiler.sentinel_service_name = mymaster {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] profiler.socket_timeout = 0.1 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] profiler.trace_requests = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] profiler.trace_sqlalchemy = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] profiler_jaeger.process_tags = {} {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] profiler_jaeger.service_name_prefix = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] profiler_otlp.service_name_prefix = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_policy.enforce_new_defaults = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:05:43 devstack cinder-volume[75016]: WARNING oslo_config.cfg [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_policy.enforce_scope = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_policy.policy_default_rule = default {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_policy.policy_file = policy.yaml {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] privsep_osbrick.group = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] privsep_osbrick.helper_command = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] privsep_osbrick.user = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cinder_sys_admin.group = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cinder_sys_admin.helper_command = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] cinder_sys_admin.user = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] service_user.auth_section = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] service_user.auth_type = password {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] service_user.certfile = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] service_user.collect_timing = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] service_user.insecure = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] service_user.keyfile = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] service_user.send_service_user_token = True {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] service_user.split_loggers = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] service_user.timeout = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.backend_availability_zone = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.chap_password = **** {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.chap_username = {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.driver_client_cert = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.driver_client_cert_key = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.driver_data_namespace = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.driver_use_ssl = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.extra_capabilities = {} {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.filter_function = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.goodness_function = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.iscsi_iotype = fileio {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.iscsi_target_flags = {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.iscsi_write_cache = on {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.iser_helper = tgtadm {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.iser_ip_address = 192.168.122.60 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.iser_port = 3260 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.lvm_share_target = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.lvm_type = auto {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.num_shell_tries = 3 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.replication_device = **** {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.report_discard_supported = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.reserved_percentage = 0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.target_helper = tgtadm {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.target_ip_address = 192.168.122.60 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.target_port = 3260 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.target_protocol = iscsi {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.trace_flags = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.unique_fqdn_network = True {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.use_chap_auth = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.volume_backend_name = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.volume_clear = zero {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.volume_clear_ionice = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.volume_clear_size = 0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_reports.file_event_handler = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_reports.log_dir = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.backend_host = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.chap_password = **** {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.chap_username = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.driver_client_cert = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.extra_capabilities = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.filter_function = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.goodness_function = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.iscsi_iotype = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.iser_helper = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.iser_ip_address = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.iser_port = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.lvm_share_target = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.lvm_type = auto {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.num_shell_tries = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.replication_device = **** {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.report_discard_supported = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.reserved_percentage = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.scst_target_driver = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.storage_protocol = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.target_helper = lioadm {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.target_ip_address = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.target_port = 3260 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.trace_flags = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.use_chap_auth = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.volume_clear = zero {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.volume_clear_size = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] lvmdriver-1.volumes_dir = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.193s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.ssl = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_notifications.driver = [] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_notifications.retry = -1 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] key_manager.fixed_key = **** {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] barbican.barbican_api_version = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] barbican.barbican_endpoint = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] barbican.barbican_endpoint_type = public {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] barbican.barbican_region_name = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] barbican.cafile = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] barbican.certfile = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] barbican.collect_timing = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] barbican.insecure = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] barbican.keyfile = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] barbican.number_of_retries = 60 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] barbican.retry_delay = 1 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] barbican.send_service_user_token = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] barbican.split_loggers = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] barbican.timeout = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] barbican.verify_ssl = True {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] barbican.verify_ssl_path = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] barbican_service_user.auth_section = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] barbican_service_user.auth_type = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] barbican_service_user.cafile = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] barbican_service_user.certfile = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] barbican_service_user.collect_timing = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] barbican_service_user.insecure = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] barbican_service_user.keyfile = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] barbican_service_user.split_loggers = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] barbican_service_user.timeout = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] vault.approle_role_id = **** {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] vault.approle_secret_id = **** {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] vault.kv_mountpoint = secret {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] vault.kv_path = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] vault.kv_version = 2 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] vault.namespace = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] vault.root_token_id = **** {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] vault.ssl_ca_crt_file = None {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] vault.timeout = 60.0 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] vault.use_ssl = False {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:05:43 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] ******************************************************************************** {{(pid=75016) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 10 15:05:43 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.111s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:05:43 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:05:44 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.086s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:05:44 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:05:44 devstack sudo[75217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 10 15:05:44 devstack sudo[75217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:05:46 devstack sudo[75217]: pam_unix(sudo:session): session closed for user root Sep 10 15:05:46 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 2.052s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:05:46 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:05:46 devstack sudo[75332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 15:05:46 devstack sudo[75332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:05:48 devstack sudo[75332]: pam_unix(sudo:session): session closed for user root Sep 10 15:05:48 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 1.991s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:05:48 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:05:48 devstack cinder-volume[75170]: INFO cinder.brick.local_dev.lvm [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 10 15:05:48 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:05:48 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.108s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:05:48 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:05:48 devstack sudo[75440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 15:05:48 devstack sudo[75440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:05:50 devstack sudo[75440]: pam_unix(sudo:session): session closed for user root Sep 10 15:05:50 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.245s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:05:50 devstack cinder-volume[75170]: DEBUG cinder.brick.local_dev.lvm [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75170) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Sep 10 15:05:50 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:05:50 devstack sudo[75536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 15:05:50 devstack sudo[75536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:05:53 devstack cinder-volume[75016]: DEBUG dbcounter [-] [75016] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75016) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:05:54 devstack sudo[75536]: pam_unix(sudo:session): session closed for user root Sep 10 15:05:54 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.548s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:05:54 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:05:54 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.206s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:05:54 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:05:54 devstack sudo[75735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 15:05:54 devstack sudo[75735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:05:56 devstack sudo[75735]: pam_unix(sudo:session): session closed for user root Sep 10 15:05:56 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.028s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:05:56 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:05:56 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.101s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:05:56 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:05:56 devstack sudo[75773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 10 15:05:56 devstack sudo[75773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:05:58 devstack sudo[75773]: pam_unix(sudo:session): session closed for user root Sep 10 15:05:59 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.438s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:05:59 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:05:59 devstack sudo[75815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 15:05:59 devstack sudo[75815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:06:01 devstack sudo[75815]: pam_unix(sudo:session): session closed for user root Sep 10 15:06:01 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.873s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:06:01 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:06:02 devstack sudo[75870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 15:06:02 devstack sudo[75870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:06:04 devstack sudo[75870]: pam_unix(sudo:session): session closed for user root Sep 10 15:06:04 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 3.018s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:06:05 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:06:05 devstack sudo[75875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 15:06:05 devstack sudo[75875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:06:07 devstack sudo[75875]: pam_unix(sudo:session): session closed for user root Sep 10 15:06:07 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.713s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:06:07 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:06:07 devstack sudo[75881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 15:06:07 devstack sudo[75881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:06:10 devstack sudo[75881]: pam_unix(sudo:session): session closed for user root Sep 10 15:06:10 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.616s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:06:10 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:06:10 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.150s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:06:10 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:06:10 devstack sudo[75906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 15:06:10 devstack sudo[75906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:06:12 devstack sudo[75906]: pam_unix(sudo:session): session closed for user root Sep 10 15:06:12 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.291s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:06:12 devstack cinder-volume[75170]: INFO cinder.volume.drivers.lvm [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 10 15:06:12 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:06:12 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.068s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:06:13 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:06:13 devstack sudo[76006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 15:06:13 devstack sudo[76006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:06:14 devstack sudo[76006]: pam_unix(sudo:session): session closed for user root Sep 10 15:06:15 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.986s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:06:15 devstack cinder-volume[75170]: DEBUG cinder.volume.drivers.lvm [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Updating volume stats {{(pid=75170) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 15:06:15 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:06:15 devstack sudo[76144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 15:06:15 devstack sudo[76144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:06:16 devstack sudo[76144]: pam_unix(sudo:session): session closed for user root Sep 10 15:06:16 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.907s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:06:16 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:06:17 devstack sudo[76148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 15:06:17 devstack sudo[76148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:06:19 devstack sudo[76148]: pam_unix(sudo:session): session closed for user root Sep 10 15:06:19 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.103s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:06:19 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:06:19 devstack sudo[76151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 15:06:19 devstack sudo[76151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:06:21 devstack sudo[76151]: pam_unix(sudo:session): session closed for user root Sep 10 15:06:21 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.239s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:06:21 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:06:21 devstack sudo[76156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 15:06:21 devstack sudo[76156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:06:23 devstack sudo[76156]: pam_unix(sudo:session): session closed for user root Sep 10 15:06:23 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.437s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:06:23 devstack cinder-volume[75170]: INFO cinder.volume.driver [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Driver hasn't implemented _init_vendor_properties() Sep 10 15:06:23 devstack cinder-volume[75170]: DEBUG cinder.volume.driver [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75170) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}} Sep 10 15:06:23 devstack cinder-volume[75170]: DEBUG oslo_db.sqlalchemy.engines [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75170) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 15:06:24 devstack cinder-volume[75170]: DEBUG dbcounter [-] [75170] Writer thread running {{(pid=75170) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 10 15:06:24 devstack cinder-volume[75170]: DEBUG cinder.db.sqlalchemy.api [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Building query based on filter {{(pid=75170) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}} Sep 10 15:06:24 devstack cinder-volume[75170]: DEBUG cinder.image.image_utils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75170) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}} Sep 10 15:06:24 devstack cinder-volume[75170]: INFO cinder.keymgr.migration [None req-92d3a6bb-761e-4dc7-83fc-dab558f24112 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 10 15:06:24 devstack cinder-volume[75170]: DEBUG cinder.volume.drivers.lvm [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Updating volume stats {{(pid=75170) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 15:06:24 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:06:24 devstack sudo[76163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 15:06:24 devstack sudo[76163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:06:26 devstack sudo[76163]: pam_unix(sudo:session): session closed for user root Sep 10 15:06:26 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.050s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:06:26 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:06:26 devstack sudo[76253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 15:06:26 devstack sudo[76253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:06:28 devstack sudo[76253]: pam_unix(sudo:session): session closed for user root Sep 10 15:06:28 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.337s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:06:28 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:06:28 devstack sudo[76311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 15:06:28 devstack sudo[76311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:06:31 devstack sudo[76311]: pam_unix(sudo:session): session closed for user root Sep 10 15:06:31 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.313s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:06:31 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:06:31 devstack sudo[76344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 15:06:31 devstack sudo[76344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:06:32 devstack sudo[76344]: pam_unix(sudo:session): session closed for user root Sep 10 15:06:33 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.942s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:06:33 devstack cinder-volume[75170]: DEBUG cinder.manager [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Notifying Schedulers of capabilities ... {{(pid=75170) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:06:33 devstack cinder-volume[75170]: INFO cinder.volume.manager [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Driver initialization completed successfully. Sep 10 15:06:33 devstack cinder-volume[75170]: INFO cinder.manager [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Initiating service 2 cleanup Sep 10 15:06:33 devstack cinder-volume[75170]: INFO cinder.manager [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Service 2 cleanup completed. Sep 10 15:06:33 devstack cinder-volume[75170]: DEBUG cinder.service [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Creating RPC server for service cinder-volume {{(pid=75170) start /opt/stack/cinder/cinder/service.py:239}} Sep 10 15:06:33 devstack cinder-volume[75170]: DEBUG cinder.service [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75170) start /opt/stack/cinder/cinder/service.py:245}} Sep 10 15:06:33 devstack cinder-volume[75170]: INFO cinder.volume.manager [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 10 15:06:33 devstack cinder-volume[75170]: DEBUG cinder.volume.drivers.lvm [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Updating volume stats {{(pid=75170) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 15:06:33 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:06:33 devstack sudo[76349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 15:06:33 devstack sudo[76349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:06:35 devstack sudo[76349]: pam_unix(sudo:session): session closed for user root Sep 10 15:06:35 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.923s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:06:35 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:06:35 devstack sudo[76357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 15:06:35 devstack sudo[76357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:06:37 devstack sudo[76357]: pam_unix(sudo:session): session closed for user root Sep 10 15:06:37 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.877s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:06:37 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:06:37 devstack sudo[76361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 15:06:37 devstack sudo[76361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:06:39 devstack sudo[76361]: pam_unix(sudo:session): session closed for user root Sep 10 15:06:39 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.079s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:06:39 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:06:39 devstack sudo[76368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 15:06:39 devstack sudo[76368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:06:41 devstack sudo[76368]: pam_unix(sudo:session): session closed for user root Sep 10 15:06:41 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.767s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:06:41 devstack cinder-volume[75170]: DEBUG dbcounter [-] [75170] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75170) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:06:41 devstack cinder-volume[75170]: INFO cinder.volume.manager [None req-cc75309e-43c1-4309-b9d3-6762a03f8a53 None None] Driver post RPC initialization completed successfully. Sep 10 15:06:51 devstack cinder-volume[75170]: DEBUG dbcounter [-] [75170] Writing DB stats cinder:SELECT=3 {{(pid=75170) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:07:39 devstack cinder-volume[75170]: DEBUG oslo_service.periodic_task [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75170) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:07:39 devstack cinder-volume[75170]: DEBUG cinder.volume.drivers.lvm [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Updating volume stats {{(pid=75170) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 15:07:39 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:07:39 devstack sudo[77578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 15:07:39 devstack sudo[77578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:07:41 devstack sudo[77578]: pam_unix(sudo:session): session closed for user root Sep 10 15:07:41 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.990s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:07:41 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:07:41 devstack sudo[77663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 15:07:41 devstack sudo[77663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:07:43 devstack sudo[77663]: pam_unix(sudo:session): session closed for user root Sep 10 15:07:43 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.107s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:07:43 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:07:43 devstack sudo[77715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 15:07:43 devstack sudo[77715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:07:45 devstack sudo[77715]: pam_unix(sudo:session): session closed for user root Sep 10 15:07:45 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.946s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:07:45 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:07:45 devstack sudo[77721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 15:07:45 devstack sudo[77721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:07:47 devstack sudo[77721]: pam_unix(sudo:session): session closed for user root Sep 10 15:07:47 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.018s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:07:47 devstack cinder-volume[75170]: DEBUG cinder.manager [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Notifying Schedulers of capabilities ... {{(pid=75170) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:08:39 devstack cinder-volume[75170]: DEBUG oslo_service.periodic_task [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75170) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:08:39 devstack cinder-volume[75170]: DEBUG cinder.volume.drivers.lvm [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Updating volume stats {{(pid=75170) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 15:08:39 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:08:39 devstack sudo[78160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 15:08:39 devstack sudo[78160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:08:41 devstack sudo[78160]: pam_unix(sudo:session): session closed for user root Sep 10 15:08:41 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.149s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:08:41 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:08:41 devstack sudo[78163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 15:08:41 devstack sudo[78163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:08:43 devstack sudo[78163]: pam_unix(sudo:session): session closed for user root Sep 10 15:08:43 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.106s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:08:43 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:08:43 devstack sudo[78184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 15:08:43 devstack sudo[78184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:08:45 devstack sudo[78184]: pam_unix(sudo:session): session closed for user root Sep 10 15:08:45 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.044s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:08:45 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:08:45 devstack sudo[78187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 15:08:45 devstack sudo[78187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:08:47 devstack sudo[78187]: pam_unix(sudo:session): session closed for user root Sep 10 15:08:47 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.882s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:08:47 devstack cinder-volume[75170]: DEBUG cinder.manager [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Notifying Schedulers of capabilities ... {{(pid=75170) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:08:51 devstack cinder-volume[75170]: DEBUG dbcounter [-] [75170] Writing DB stats cinder:SELECT=1 {{(pid=75170) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:08:51 devstack cinder-volume[75170]: DEBUG dbcounter [-] [75170] Writing DB stats cinder:UPDATE=1 {{(pid=75170) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:09:39 devstack cinder-volume[75170]: DEBUG oslo_service.periodic_task [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75170) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:09:39 devstack cinder-volume[75170]: DEBUG cinder.volume.drivers.lvm [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Updating volume stats {{(pid=75170) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 15:09:39 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:09:39 devstack sudo[80734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 15:09:39 devstack sudo[80734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:09:41 devstack sudo[80734]: pam_unix(sudo:session): session closed for user root Sep 10 15:09:41 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.044s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:09:41 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:09:41 devstack sudo[80873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 15:09:41 devstack sudo[80873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:09:43 devstack sudo[80873]: pam_unix(sudo:session): session closed for user root Sep 10 15:09:43 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.067s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:09:43 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:09:43 devstack sudo[81009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 15:09:43 devstack sudo[81009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:09:45 devstack sudo[81009]: pam_unix(sudo:session): session closed for user root Sep 10 15:09:45 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.033s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:09:45 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:09:45 devstack sudo[81146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 15:09:45 devstack sudo[81146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:09:47 devstack sudo[81146]: pam_unix(sudo:session): session closed for user root Sep 10 15:09:47 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.032s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:09:47 devstack cinder-volume[75170]: DEBUG cinder.manager [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Notifying Schedulers of capabilities ... {{(pid=75170) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:10:39 devstack cinder-volume[75170]: DEBUG oslo_service.periodic_task [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75170) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:10:39 devstack cinder-volume[75170]: DEBUG cinder.volume.drivers.lvm [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Updating volume stats {{(pid=75170) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 15:10:39 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:10:39 devstack sudo[81428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 15:10:39 devstack sudo[81428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:10:41 devstack sudo[81428]: pam_unix(sudo:session): session closed for user root Sep 10 15:10:41 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.902s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:10:41 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:10:41 devstack sudo[81435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 15:10:41 devstack sudo[81435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:10:43 devstack sudo[81435]: pam_unix(sudo:session): session closed for user root Sep 10 15:10:43 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.065s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:10:43 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:10:43 devstack sudo[81443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 15:10:43 devstack sudo[81443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:10:45 devstack sudo[81443]: pam_unix(sudo:session): session closed for user root Sep 10 15:10:45 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.979s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:10:45 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:10:45 devstack sudo[81454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 15:10:45 devstack sudo[81454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:10:47 devstack sudo[81454]: pam_unix(sudo:session): session closed for user root Sep 10 15:10:47 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.959s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:10:47 devstack cinder-volume[75170]: DEBUG cinder.manager [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Notifying Schedulers of capabilities ... {{(pid=75170) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:10:51 devstack cinder-volume[75170]: DEBUG dbcounter [-] [75170] Writing DB stats cinder:SELECT=1 {{(pid=75170) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:10:51 devstack cinder-volume[75170]: DEBUG dbcounter [-] [75170] Writing DB stats cinder:UPDATE=1 {{(pid=75170) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:11:39 devstack cinder-volume[75170]: DEBUG oslo_service.periodic_task [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75170) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:11:39 devstack cinder-volume[75170]: DEBUG cinder.volume.drivers.lvm [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Updating volume stats {{(pid=75170) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 10 15:11:39 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:11:39 devstack sudo[81641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 10 15:11:39 devstack sudo[81641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:11:41 devstack sudo[81641]: pam_unix(sudo:session): session closed for user root Sep 10 15:11:41 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.936s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:11:41 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:11:41 devstack sudo[81652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 15:11:41 devstack sudo[81652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:11:43 devstack sudo[81652]: pam_unix(sudo:session): session closed for user root Sep 10 15:11:43 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.856s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:11:43 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:11:43 devstack sudo[81656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 10 15:11:43 devstack sudo[81656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:11:45 devstack sudo[81656]: pam_unix(sudo:session): session closed for user root Sep 10 15:11:45 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.070s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:11:45 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:11:45 devstack sudo[81671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 10 15:11:45 devstack sudo[81671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:11:47 devstack sudo[81671]: pam_unix(sudo:session): session closed for user root Sep 10 15:11:47 devstack cinder-volume[75170]: DEBUG oslo_concurrency.processutils [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.824s {{(pid=75170) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:11:47 devstack cinder-volume[75170]: DEBUG cinder.manager [None req-11a62f73-7c3d-49de-b990-46c2754ded69 None None] Notifying Schedulers of capabilities ... {{(pid=75170) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:12:27 devstack cinder-volume[75016]: INFO oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Caught SIGTERM, stopping children Sep 10 15:12:27 devstack cinder-volume[75016]: DEBUG oslo_concurrency.lockutils [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Acquiring lock "singleton_lock" {{(pid=75016) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 10 15:12:27 devstack cinder-volume[75016]: DEBUG oslo_concurrency.lockutils [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Acquired lock "singleton_lock" {{(pid=75016) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 10 15:12:27 devstack cinder-volume[75016]: DEBUG oslo_concurrency.lockutils [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Releasing lock "singleton_lock" {{(pid=75016) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 10 15:12:27 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Stop services. {{(pid=75016) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}} Sep 10 15:12:27 devstack cinder-volume[75016]: DEBUG oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Killing children. {{(pid=75016) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}} Sep 10 15:12:27 devstack cinder-volume[75016]: INFO oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Waiting on 1 children to exit Sep 10 15:12:28 devstack cinder-volume[75170]: DEBUG oslo_concurrency.lockutils [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Acquiring lock "singleton_lock" {{(pid=75170) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 10 15:12:28 devstack cinder-volume[75170]: DEBUG oslo_concurrency.lockutils [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Acquired lock "singleton_lock" {{(pid=75170) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 10 15:12:28 devstack cinder-volume[75170]: DEBUG oslo_concurrency.lockutils [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Releasing lock "singleton_lock" {{(pid=75170) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 10 15:12:28 devstack cinder-volume[75170]: WARNING amqp [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 10 15:12:28 devstack cinder-volume[75170]: WARNING amqp [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 10 15:12:28 devstack cinder-volume[75016]: INFO oslo_service.backend._eventlet.service [None req-209355b1-17df-4e64-b7fe-6578e3850a63 None None] Child 75170 exited with status 0 Sep 10 15:12:46 devstack cinder-volume[82558]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82558) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 10 15:12:46 devstack cinder-volume[82558]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82558) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 10 15:12:46 devstack cinder-volume[82558]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82558) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 10 15:12:50 devstack cinder-volume[82558]: INFO dbcounter [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] Registered counter for database cinder Sep 10 15:12:50 devstack cinder-volume[82558]: DEBUG oslo_db.sqlalchemy.engines [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82558) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 15:12:50 devstack cinder-volume[82558]: DEBUG dbcounter [-] [82558] Writer thread running {{(pid=82558) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 10 15:12:50 devstack cinder-volume[82558]: INFO cinder.rpc [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 10 15:12:50 devstack cinder-volume[82558]: INFO cinder.rpc [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 10 15:12:50 devstack cinder-volume[82558]: DEBUG oslo_db.sqlalchemy.engines [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82558) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 15:12:51 devstack cinder-volume[82558]: INFO cinder.volume.manager [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] Determined volume DB was empty at startup. Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG cinder.volume.manager [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82558) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 10 15:12:51 devstack cinder-volume[82558]: INFO cinder.volume.manager [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 10 15:12:51 devstack cinder-volume[82558]: WARNING stevedore.named [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 10 15:12:51 devstack cinder-volume[82558]: WARNING castellan.key_manager [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 15:12:51 devstack cinder-volume[82558]: WARNING cinder.keymgr.conf_key_mgr [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 10 15:12:51 devstack cinder-volume[82558]: INFO cinder.volume.manager [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_db.sqlalchemy.engines [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82558) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 15:12:51 devstack cinder-volume[82558]: INFO oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] Starting 1 workers Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] Started child 82800 {{(pid=82558) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] Full set of CONF: {{(pid=82558) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] ******************************************************************************** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] Configuration options gathered from: {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] ================================================================================ {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] allow_availability_zone_fallback = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] allow_compression_on_image_upload = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] allowed_direct_url_schemes = [] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] api_rate_limit = True {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] auth_strategy = keystone {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_availability_zone = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_host = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_name = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_stats_polling_interval = 60 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backup_api_class = cinder.backup.api.API {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backup_name_template = backup-%s {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backup_use_same_host = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backup_use_temp_snapshot = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] chap_password = **** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] chap_username = {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cinder_internal_tenant_project_id = c8021a5588794091aab8a967b3c45985 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cinder_internal_tenant_user_id = 826588877da047428a583411702258d5 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cluster = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] compression_format = gzip {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] compute_api_class = cinder.compute.nova.API {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] config_dir = [] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] config_source = [] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] control_exchange = openstack {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] debug = True {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] default_availability_zone = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] default_group_type = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] default_volume_type = QuobyteHD {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] driver_client_cert = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] driver_client_cert_key = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] driver_data_namespace = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] driver_ssl_cert_path = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82800]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0) Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] driver_ssl_cert_verify = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] driver_use_ssl = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] enable_new_services = True {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] enable_unsupported_driver = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] enabled_backends = ['QuobyteHD'] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] enforce_multipath_for_image_xfer = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] filter_function = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] glance_api_insecure = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] glance_api_servers = ['http://192.168.122.60/image'] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] glance_api_ssl_compression = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] glance_ca_certificates_file = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] glance_catalog_info = image:glance:publicURL {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] glance_certfile = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] glance_keyfile = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] glance_num_retries = 3 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] glance_request_timeout = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] goodness_function = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] graceful_shutdown_timeout = 5 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] group_api_class = cinder.group.api.API {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] host = devstack {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] image_compress_on_upload = True {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] image_conversion_address_space_limit = 1 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] image_conversion_cpu_limit = 60 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] image_conversion_disable = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] image_upload_use_cinder_backend = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] image_upload_use_internal_tenant = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] image_volume_cache_enabled = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] image_volume_cache_max_count = 0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] image_volume_cache_max_size_gb = 0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] init_host_max_objects_retrieval = 0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] instance_format = [instance: %(uuid)s] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] iscsi_iotype = fileio {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] iscsi_target_flags = {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] iscsi_write_cache = on {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] iser_helper = tgtadm {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] iser_ip_address = 192.168.122.60 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] iser_port = 3260 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] log_color = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] log_config_append = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] log_dir = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] log_file = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] log_options = True {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] log_rotate_interval = 1 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] log_rotate_interval_type = days {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] log_rotation_type = none {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] max_age = 0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] max_logfile_count = 30 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] max_logfile_size_mb = 200 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] max_over_subscription_ratio = 20.0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] message_reap_interval = 86400 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] message_ttl = 2592000 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] migration_create_volume_timeout_secs = 300 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] monkey_patch = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] monkey_patch_modules = [] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] my_ip = 192.168.122.60 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] no_snapshot_gb_quota = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] num_iser_scan_tries = 3 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] num_shell_tries = 3 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] num_volume_device_scan_tries = 3 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] nvmeof_conn_info_version = 1 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] nvmet_ns_id = 10 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] nvmet_port_id = 1 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] osapi_max_limit = 1000 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] osapi_volume_ext_list = [] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] osapi_volume_listen_port = 8776 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] osapi_volume_use_ssl = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] osapi_volume_workers = 2 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] per_volume_size_limit = -1 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] periodic_fuzzy_delay = 60 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] periodic_interval = 60 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] public_endpoint = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] publish_errors = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] quota_backup_gigabytes = 1000 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] quota_backups = 10 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] quota_gigabytes = 1000 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] quota_groups = 10 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] quota_snapshots = 10 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] quota_volumes = 10 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] rate_limit_burst = 0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] rate_limit_except_level = CRITICAL {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] rate_limit_interval = 0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] reinit_driver_count = 3 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] replication_device = **** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] report_discard_supported = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] report_interval = 120 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] reservation_clean_interval = 86400 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] reservation_expire = 86400 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] reserved_image_namespaces = [] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] reserved_percentage = 0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:51 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] rpc_response_timeout = 120 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] run_external_periodic_tasks = True {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] scst_target_driver = iscsi {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] scst_target_iqn_name = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] service_down_time = 720 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] shell_completion = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] snapshot_name_template = snapshot-%s {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] split_loggers = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] state_path = /opt/stack/data/cinder {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] storage_availability_zone = nova {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] storage_protocol = iSCSI {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] syslog_log_facility = LOG_USER {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] target_helper = lioadm {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] target_ip_address = 192.168.122.60 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] target_port = 3260 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] target_protocol = iscsi {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] target_secondary_ip_addresses = [] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] trace_flags = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] transport_url = **** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] until_refresh = 0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] use_chap_auth = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] use_default_quota_class = True {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] use_journal = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] use_json = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] use_multipath_for_image_xfer = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] use_stderr = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] use_syslog = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] verify_glance_signatures = enabled {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] volume_api_class = cinder.volume.api.API {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] volume_backend_name = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] volume_clear = zero {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] volume_clear_ionice = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] volume_clear_size = 0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] volume_copy_bps_limit = 0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] volume_dd_blocksize = 1M {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] volume_name_template = volume-%s {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] volume_service_inithost_offload = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] volume_usage_audit_period = month {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] watch_log_file = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] zoning_mode = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_concurrency.disable_process_locking = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.admin_password = **** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.admin_token = **** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.admin_user = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.auth_port = 35357 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.auth_protocol = https {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.auth_section = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.auth_type = password {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.auth_uri = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.auth_version = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.cache = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.certfile = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.identity_uri = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.include_service_catalog = True {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.insecure = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.interface = public {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.keyfile = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.memcache_password = {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.memcache_username = {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.region_name = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.service_type = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.backend = dogpile.cache.null {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.backend_argument = **** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.backend_expiration_time = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.config_prefix = cache.oslo {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.dead_timeout = 60.0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.debug_cache_backend = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.enable_retry_client = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.enable_socket_keepalive = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.enabled = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.enforce_fips_mode = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.expiration_time = 600 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.hashclient_retry_attempts = 2 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.hashclient_retry_delay = 1.0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.memcache_dead_retry = 300 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.memcache_password = **** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.memcache_pool_maxsize = 10 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.memcache_sasl_enabled = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.memcache_socket_timeout = 1.0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.memcache_username = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.proxies = [] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.redis_db = 0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.redis_password = **** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.redis_server = localhost:6379 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.redis_socket_timeout = 1.0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.redis_username = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.retry_attempts = 2 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.retry_delay = 0.0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.socket_keepalive_count = 1 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.socket_keepalive_idle = 1 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.socket_keepalive_interval = 1 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.tls_allowed_ciphers = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.tls_cafile = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.tls_certfile = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.tls_enabled = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cache.tls_keyfile = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] coordination.backend_url = **** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] database.asyncio_connection = **** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] database.asyncio_slave_connection = **** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] database.backend = sqlalchemy {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] database.connection = **** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] database.connection_debug = 0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] database.connection_parameters = {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] database.connection_recycle_time = 3600 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] database.connection_trace = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] database.db_inc_retry_interval = True {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] database.db_max_retries = 20 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] database.db_max_retry_interval = 10 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] database.db_retry_interval = 1 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] database.max_overflow = 50 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] database.max_pool_size = 5 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] database.max_retries = 10 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] database.mysql_wsrep_sync_wait = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] database.pool_timeout = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] database.retry_interval = 10 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] database.slave_connection = **** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] database.sqlite_synchronous = True {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] database.use_db_reconnect = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] profiler.connection_string = messaging:// {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] profiler.enabled = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] profiler.es_doc_type = notification {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] profiler.es_scroll_size = 10000 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] profiler.es_scroll_time = 2m {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] profiler.filter_error_trace = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] profiler.hmac_keys = **** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] profiler.sentinel_service_name = mymaster {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] profiler.socket_timeout = 0.1 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] profiler.trace_requests = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] profiler.trace_sqlalchemy = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] profiler_jaeger.process_tags = {} {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] profiler_jaeger.service_name_prefix = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] profiler_otlp.service_name_prefix = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_policy.enforce_new_defaults = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: WARNING oslo_config.cfg [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_policy.enforce_scope = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_policy.policy_default_rule = default {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_policy.policy_file = policy.yaml {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] privsep_osbrick.group = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] privsep_osbrick.helper_command = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] privsep_osbrick.user = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cinder_sys_admin.group = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cinder_sys_admin.helper_command = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Starting volume driver QuobyteDriver (1.1.13) Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=82800) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] cinder_sys_admin.user = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] service_user.auth_section = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] service_user.auth_type = password {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] service_user.certfile = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] service_user.collect_timing = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] service_user.insecure = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] service_user.keyfile = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] service_user.send_service_user_token = True {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] service_user.split_loggers = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] service_user.timeout = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.backend_availability_zone = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.chap_password = **** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.chap_username = {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.driver_client_cert = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.driver_client_cert_key = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.driver_data_namespace = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.driver_use_ssl = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.extra_capabilities = {} {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.filter_function = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.goodness_function = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.iscsi_iotype = fileio {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.iscsi_target_flags = {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.iscsi_write_cache = on {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.iser_helper = tgtadm {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.iser_ip_address = 192.168.122.60 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.iser_port = 3260 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.nas_host = {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.nas_login = admin {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.nas_mount_options = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.nas_password = **** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.nas_private_key = {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.nas_share_path = {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.num_shell_tries = 3 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.quobyte_volume_url = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.replication_device = **** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.report_discard_supported = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.reserved_percentage = 0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.target_helper = tgtadm {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.target_ip_address = 192.168.122.60 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.target_port = 3260 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.target_protocol = iscsi {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.trace_flags = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.unique_fqdn_network = True {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.use_chap_auth = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.volume_backend_name = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.volume_clear = zero {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.volume_clear_ionice = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.volume_clear_size = 0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_reports.file_event_handler = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_reports.log_dir = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.backend_availability_zone = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.backend_host = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.chap_password = **** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.chap_username = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.chiscsi_conf = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.driver_client_cert = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.driver_data_namespace = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.driver_use_ssl = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.extra_capabilities = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.filter_function = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.goodness_function = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.iscsi_iotype = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.iser_helper = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.iser_ip_address = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.iser_port = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.iser_target_prefix = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.nas_host = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.nas_login = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.nas_mount_options = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.nas_password = **** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.nas_private_key = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.nas_secure_file_operations = true {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.nas_share_path = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.nas_ssh_port = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.num_shell_tries = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.nvmet_port_id = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.quobyte_volume_url = quobyte://10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.replication_device = **** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.report_discard_supported = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.reserved_percentage = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.scst_target_driver = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.storage_protocol = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.target_helper = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.target_ip_address = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.target_port = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.target_prefix = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.target_protocol = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.trace_flags = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.use_chap_auth = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.volume_clear = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.volume_clear_size = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] QuobyteHD.volumes_dir = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.ssl = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_notifications.driver = [] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_notifications.retry = -1 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] key_manager.fixed_key = **** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] barbican.barbican_api_version = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] barbican.barbican_endpoint = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] barbican.barbican_endpoint_type = public {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] barbican.barbican_region_name = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] barbican.cafile = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] barbican.certfile = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] barbican.collect_timing = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] barbican.insecure = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] barbican.keyfile = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] barbican.number_of_retries = 60 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] barbican.retry_delay = 1 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] barbican.send_service_user_token = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] barbican.split_loggers = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] barbican.timeout = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] barbican.verify_ssl = True {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] barbican.verify_ssl_path = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] barbican_service_user.auth_section = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] barbican_service_user.auth_type = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] barbican_service_user.cafile = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] barbican_service_user.certfile = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] barbican_service_user.collect_timing = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] barbican_service_user.insecure = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] barbican_service_user.keyfile = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] barbican_service_user.split_loggers = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] barbican_service_user.timeout = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] vault.approle_role_id = **** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] vault.approle_secret_id = **** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] vault.kv_mountpoint = secret {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] vault.kv_path = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] vault.kv_version = 2 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] vault.namespace = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] vault.root_token_id = **** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] vault.ssl_ca_crt_file = None {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] vault.timeout = 60.0 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] vault.use_ssl = False {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 10 15:12:52 devstack cinder-volume[82558]: DEBUG oslo_service.backend._eventlet.service [None req-7accc1cd-0d0e-4d93-a7a2-b6d48dec0be2 None None] ******************************************************************************** {{(pid=82558) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 10 15:12:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=82800) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Sep 10 15:12:52 devstack cinder-volume[82800]: INFO cinder.volume.drivers.quobyte [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual. Sep 10 15:12:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Running cmd (subprocess): mount.quobyte {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:12:53 devstack quobyte-client[82801]: Reading configuration file: /etc/quobyte/client.cfg Sep 10 15:12:53 devstack quobyte-client[82801]: Invalid parameters found, error: missing mount point. Sep 10 15:12:53 devstack quobyte-client[82801]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 10 15:12:53 devstack quobyte-client[82801]: Failed to parse all commandline parameters, please use -h/--help to see available options. Sep 10 15:12:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] CMD "mount.quobyte" returned: 1 in 0.589s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:12:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:12:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:12:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:12:53 devstack cinder-volume[82800]: INFO cinder.volume.drivers.quobyte [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Mounting volume: 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 ... Sep 10 15:12:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf -c /etc/quobyte/client-cinder.cfg {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:12:54 devstack quobyte-client[82802]: Reading configuration file: /etc/quobyte/client-cinder.cfg Sep 10 15:12:54 devstack quobyte-client[82802]: Reading configuration file: /etc/quobyte/client.cfg Sep 10 15:12:54 devstack quobyte-client[82802]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf' to display the log. Sep 10 15:12:54 devstack quobyte-client[82814]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic). Sep 10 15:12:54 devstack quobyte-client[82814]: mount.quobyte 3.25 (4fbbd59204) Sep 10 15:12:54 devstack quobyte-client[82814]: Client UUID: HBv8tKD5-g8M9-HRxw-PYWG-1pvGiDBEIw8U Sep 10 15:12:54 devstack quobyte-client[82814]: Registry: osci01.corp.quobyte.com:7861 Sep 10 15:12:54 devstack quobyte-client[82814]: Volume: cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:12:54 devstack quobyte-client[82814]: FUSE version: 316 Sep 10 15:12:54 devstack quobyte-client[82814]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps) Sep 10 15:12:54 devstack quobyte-client[82814]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied Sep 10 15:12:54 devstack quobyte-client[82814]: Setting total object cache size to 3352297472 bytes Sep 10 15:12:54 devstack quobyte-client[82814]: Using FUSE low-level API Sep 10 15:12:54 devstack quobyte-client[82814]: Caching of uid/gid to user/group name mappings is enabled Sep 10 15:12:54 devstack quobyte-client[82814]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10 Sep 10 15:12:54 devstack quobyte-client[82814]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab. Sep 10 15:12:54 devstack quobyte-client[82814]: HTTP server started on port 55000 Sep 10 15:12:54 devstack quobyte-client[82814]: Caching mappings from uid/gid to user/group name and group membership temporarily. Sep 10 15:12:54 devstack quobyte-client[82814]: Mount point /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf established Sep 10 15:12:54 devstack quobyte-client[82814]: TimeSync is running and remote sync every 60 seconds Sep 10 15:12:54 devstack quobyte-client[82814]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 10 15:12:54 devstack quobyte-client[82814]: Ignored time synchronization message because time source took too long to respond (117 ms) Sep 10 15:12:54 devstack quobyte-client[82814]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 10 15:12:54 devstack quobyte-client[82814]: Opening volume cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 (901d48c4-abeb-4e73-8233-dbfe6d0c74aa) Sep 10 15:12:54 devstack quobyte-client[82814]: Setting metadata cache size to 500000 based on available system memory of 16 GiB Sep 10 15:12:54 devstack quobyte-client[82814]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 10 15:12:54 devstack quobyte-client[82814]: Failed to invalidate inode: 38: Function not implemented Sep 10 15:12:54 devstack quobyte-client[82814]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 10 15:12:54 devstack quobyte-client[82814]: Automatic minidump upload enabled by global system configuration Sep 10 15:12:54 devstack quobyte-client[82814]: Announcing HTTP status server address 172.24.4.1 Sep 10 15:12:54 devstack quobyte-client[82814]: Registered as service (uuid HBv8tKD5-g8M9-HRxw-PYWG-1pvGiDBEIw8U) Sep 10 15:12:54 devstack quobyte-client[82814]: Quobyte Client running as pid 82814 Sep 10 15:12:54 devstack quobyte-client[82814]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2 Sep 10 15:12:54 devstack quobyte-client[82814]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl Sep 10 15:12:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf -c /etc/quobyte/client-cinder.cfg" returned: 0 in 1.571s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:12:55 devstack cinder-volume[82800]: INFO cinder.volume.drivers.quobyte [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Mounting volume: 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 succeeded Sep 10 15:12:55 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:12:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 1.785s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:12:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:12:55 devstack quobyte-client[82814]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 10 15:12:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.219s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:12:55 devstack cinder-volume[82800]: INFO cinder.volume.driver [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Driver hasn't implemented _init_vendor_properties() Sep 10 15:12:55 devstack cinder-volume[82800]: DEBUG cinder.volume.driver [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.914478302002, 'free_capacity_gb': 924.914478302002, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82800) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}} Sep 10 15:12:55 devstack cinder-volume[82800]: DEBUG oslo_db.sqlalchemy.engines [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82800) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 10 15:12:56 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writer thread running {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 10 15:12:56 devstack cinder-volume[82800]: DEBUG cinder.db.sqlalchemy.api [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Building query based on filter {{(pid=82800) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}} Sep 10 15:12:56 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82800) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}} Sep 10 15:12:56 devstack cinder-volume[82800]: INFO cinder.keymgr.migration [None req-e9808705-e0a2-469d-a535-b6b016845506 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 10 15:12:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:12:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:12:56 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:12:56 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:12:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:12:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:12:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.078s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:12:56 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:12:56 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Driver initialization completed successfully. Sep 10 15:12:56 devstack cinder-volume[82800]: INFO cinder.manager [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Initiating service 3 cleanup Sep 10 15:12:57 devstack cinder-volume[82800]: INFO cinder.manager [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Service 3 cleanup completed. Sep 10 15:12:57 devstack cinder-volume[82800]: DEBUG cinder.service [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Creating RPC server for service cinder-volume {{(pid=82800) start /opt/stack/cinder/cinder/service.py:239}} Sep 10 15:12:57 devstack cinder-volume[82800]: DEBUG cinder.service [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82800) start /opt/stack/cinder/cinder/service.py:245}} Sep 10 15:12:57 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13) Sep 10 15:12:57 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:12:57 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:12:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:12:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:12:57 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:12:57 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:12:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:12:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:12:57 devstack quobyte-client[82814]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 10 15:12:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.162s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:12:57 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-8045fd98-01b8-40cc-8bac-8671fa45d36e None None] Driver post RPC initialization completed successfully. Sep 10 15:13:01 devstack cinder-volume[82558]: DEBUG dbcounter [-] [82558] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82558) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:13:07 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=3 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:13:07 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:14:04 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:14:04 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:14:04 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Flow 'volume_create_manager' (43b23da6-aef2-456d-b000-67e78c21dafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:14:04 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4902d55e-5f43-4d47-99db-cc092a219c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:14:04 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4902d55e-5f43-4d47-99db-cc092a219c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-185002310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738faa19-6029-4f6e-a754-58ecb5f415b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aa7fd05e3ac42aa8292c1551c006005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:14:04Z,use_quota=True,user_id='2275b4be3ed746f7ab9ba8bf218d1711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:14:04 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28272855-d205-4858-bf81-5c92eedbe24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:14:04 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28272855-d205-4858-bf81-5c92eedbe24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:14:04 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ee91cb-538f-4af2-be1a-170f7f11b499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:14:04 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ee91cb-538f-4af2-be1a-170f7f11b499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '738faa19-6029-4f6e-a754-58ecb5f415b9', 'volume_name': 'volume-738faa19-6029-4f6e-a754-58ecb5f415b9', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:14:05 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7bf2f7-a6e3-4a00-b814-942ee0de527b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:14:05 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7bf2f7-a6e3-4a00-b814-942ee0de527b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:14:05 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e86d0fb-b6d7-4d37-bcf1-a110e091d0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:14:05 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Volume 738faa19-6029-4f6e-a754-58ecb5f415b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-738faa19-6029-4f6e-a754-58ecb5f415b9', 'volume_size': 1} Sep 10 15:14:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:14:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:14:05 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-185002310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738faa19-6029-4f6e-a754-58ecb5f415b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aa7fd05e3ac42aa8292c1551c006005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:14:04Z,use_quota=True,user_id='2275b4be3ed746f7ab9ba8bf218d1711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:14:05 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Creating volume 738faa19-6029-4f6e-a754-58ecb5f415b9 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:14:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:14:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:14:05 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:14:05 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:14:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:14:05 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:14:05 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:14:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-738faa19-6029-4f6e-a754-58ecb5f415b9 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:14:05 devstack quobyte-client[82814]: System call of process 83092 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:14:05 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=2, name=volume-738faa19-6029-4f6e-a754-58ecb5f415b9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:14:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-738faa19-6029-4f6e-a754-58ecb5f415b9 1073741824" returned: 0 in 1.237s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:14:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-738faa19-6029-4f6e-a754-58ecb5f415b9 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:14:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-738faa19-6029-4f6e-a754-58ecb5f415b9" returned: 0 in 0.109s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:14:06 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] <== create_volume: return (1427ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:14:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:14:06 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e86d0fb-b6d7-4d37-bcf1-a110e091d0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-738faa19-6029-4f6e-a754-58ecb5f415b9', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:14:06 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64a0768f-ab88-49d8-862f-b3ce187456c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:14:06 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Volume volume-738faa19-6029-4f6e-a754-58ecb5f415b9 (738faa19-6029-4f6e-a754-58ecb5f415b9): created successfully Sep 10 15:14:06 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64a0768f-ab88-49d8-862f-b3ce187456c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:14:06 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Flow 'volume_create_manager' (43b23da6-aef2-456d-b000-67e78c21dafa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:14:06 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-cd8c1521-8b2b-463c-85c0-b105c10b8000 tempest-TaggedAttachmentsTest-1500355993 None] Created volume successfully. Sep 10 15:14:16 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:14:16 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=2,cinder:DELETE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:14:22 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:14:23 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:14:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Flow 'volume_create_manager' (b585bd76-e450-42d7-836e-91be04acd523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:14:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0632d9fa-6c47-40b6-8926-fcc0a5d07a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:14:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0632d9fa-6c47-40b6-8926-fcc0a5d07a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-969206245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9b0113-bda3-4fbe-8e94-edafdac97c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f9507dd3caa48918cc5aceb40e59f3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:14:23Z,use_quota=True,user_id='129a4814a3644205ac9121286e47ff40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:14:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5305e13c-668d-4e90-a12c-e95012428abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:14:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5305e13c-668d-4e90-a12c-e95012428abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:14:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c25bb047-440d-4f30-b923-e2f7c0ecda78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:14:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c25bb047-440d-4f30-b923-e2f7c0ecda78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c9b0113-bda3-4fbe-8e94-edafdac97c32', 'volume_name': 'volume-9c9b0113-bda3-4fbe-8e94-edafdac97c32', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:14:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e7b4bd-05cb-436e-a4bd-42fd9e389825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:14:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e7b4bd-05cb-436e-a4bd-42fd9e389825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:14:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d123ad88-ad32-4f41-af11-2a54f58e7807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:14:23 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Volume 9c9b0113-bda3-4fbe-8e94-edafdac97c32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c9b0113-bda3-4fbe-8e94-edafdac97c32', 'volume_size': 1} Sep 10 15:14:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:14:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:14:23 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-969206245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c9b0113-bda3-4fbe-8e94-edafdac97c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f9507dd3caa48918cc5aceb40e59f3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:14:23Z,use_quota=True,user_id='129a4814a3644205ac9121286e47ff40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:14:23 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Creating volume 9c9b0113-bda3-4fbe-8e94-edafdac97c32 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:14:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:14:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:14:23 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:14:23 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:14:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:14:23 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:14:23 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:14:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9c9b0113-bda3-4fbe-8e94-edafdac97c32 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:14:24 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=3, name=volume-9c9b0113-bda3-4fbe-8e94-edafdac97c32, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:14:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9c9b0113-bda3-4fbe-8e94-edafdac97c32 1073741824" returned: 0 in 0.758s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:14:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9c9b0113-bda3-4fbe-8e94-edafdac97c32 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:14:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9c9b0113-bda3-4fbe-8e94-edafdac97c32" returned: 0 in 0.401s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:14:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] <== create_volume: return (1360ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:14:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:14:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d123ad88-ad32-4f41-af11-2a54f58e7807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c9b0113-bda3-4fbe-8e94-edafdac97c32', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:14:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9102b940-fc18-4953-9007-9fc174425915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:14:26 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Volume volume-9c9b0113-bda3-4fbe-8e94-edafdac97c32 (9c9b0113-bda3-4fbe-8e94-edafdac97c32): created successfully Sep 10 15:14:26 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9102b940-fc18-4953-9007-9fc174425915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:14:26 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Flow 'volume_create_manager' (b585bd76-e450-42d7-836e-91be04acd523) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:14:26 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-b8ffb5ce-9102-449d-977c-8fd9233d0fab tempest-VolumesAssistedSnapshotsTest-1124771453 None] Created volume successfully. Sep 10 15:14:28 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:14:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:14:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:14:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:14:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:14:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:14:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:14:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.166s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:14:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:14:36 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:14:36 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:15:08 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:15:08 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:15:28 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:15:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:15:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:15:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:15:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:15:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:15:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:15:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.259s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:15:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:16:27 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:16:27 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:16:27 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Flow 'volume_create_manager' (cb532deb-80af-45d4-9e73-7112cbc290b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:16:27 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6917be5-6ee2-49bd-a21a-aedd65b062fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:16:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6917be5-6ee2-49bd-a21a-aedd65b062fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-428288191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a355e809-bde8-4d5e-b306-7a199fc66ad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='238d29d557be4039b8fe5b03ff8981f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:16:27Z,use_quota=True,user_id='77b055312ddf46b2b944a4ec54e56621',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:16:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (548c65e1-a2e6-480c-9649-eb39953f3a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:16:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (548c65e1-a2e6-480c-9649-eb39953f3a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:16:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc258ffe-710c-4fba-aeca-ae9b553c7e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:16:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc258ffe-710c-4fba-aeca-ae9b553c7e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a355e809-bde8-4d5e-b306-7a199fc66ad5', 'volume_name': 'volume-a355e809-bde8-4d5e-b306-7a199fc66ad5', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:16:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fad2d3e-8c41-48ed-9ff8-ed28d4546bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:16:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fad2d3e-8c41-48ed-9ff8-ed28d4546bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:16:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defcbcd0-db81-48cd-99c4-c0bfbb323464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:16:28 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Volume a355e809-bde8-4d5e-b306-7a199fc66ad5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a355e809-bde8-4d5e-b306-7a199fc66ad5', 'volume_size': 1} Sep 10 15:16:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:16:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:16:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-428288191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a355e809-bde8-4d5e-b306-7a199fc66ad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='238d29d557be4039b8fe5b03ff8981f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:16:27Z,use_quota=True,user_id='77b055312ddf46b2b944a4ec54e56621',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:16:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Creating volume a355e809-bde8-4d5e-b306-7a199fc66ad5 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:16:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:16:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:16:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:16:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:16:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:16:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:16:28 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:16:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-a355e809-bde8-4d5e-b306-7a199fc66ad5 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:16:28 devstack quobyte-client[82814]: System call of process 84152 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:16:28 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=4, name=volume-a355e809-bde8-4d5e-b306-7a199fc66ad5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:16:28 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:16:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:16:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:16:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:16:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:16:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:16:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:16:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-a355e809-bde8-4d5e-b306-7a199fc66ad5 1073741824" returned: 0 in 1.363s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:16:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-a355e809-bde8-4d5e-b306-7a199fc66ad5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:16:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.532s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:16:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:16:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-a355e809-bde8-4d5e-b306-7a199fc66ad5" returned: 0 in 0.426s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:16:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] <== create_volume: return (1878ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:16:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:16:30 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defcbcd0-db81-48cd-99c4-c0bfbb323464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a355e809-bde8-4d5e-b306-7a199fc66ad5', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:16:30 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d7a501-73d6-43e6-8cf8-71731d0663ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:16:30 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Volume volume-a355e809-bde8-4d5e-b306-7a199fc66ad5 (a355e809-bde8-4d5e-b306-7a199fc66ad5): created successfully Sep 10 15:16:30 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d7a501-73d6-43e6-8cf8-71731d0663ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:16:30 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Flow 'volume_create_manager' (cb532deb-80af-45d4-9e73-7112cbc290b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:16:30 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-8ec759a4-b8e9-464e-9d92-16a3cda9565b tempest-AttachSCSIVolumeTestJSON-1251632728 None] Created volume successfully. Sep 10 15:16:40 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:16:40 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:16:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-5785295d-8658-4da3-bafa-bce33772f0cd req-1bb0fdbc-2fec-4222-959f-9945ef6120c8 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:16:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-5785295d-8658-4da3-bafa-bce33772f0cd req-1bb0fdbc-2fec-4222-959f-9945ef6120c8 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.011s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:16:42 devstack cinder-volume[82800]: INFO oslo.privsep.daemon [req-5785295d-8658-4da3-bafa-bce33772f0cd req-1bb0fdbc-2fec-4222-959f-9945ef6120c8 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpz71npaap/privsep.sock'] Sep 10 15:16:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-ea58ed99-f7da-483b-93f9-6e417a5a627f req-876c1b9b-b17b-42bc-961a-c5976c2a31e1 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:16:42 devstack sudo[84212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpz71npaap/privsep.sock Sep 10 15:16:42 devstack sudo[84212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:16:50 devstack sudo[84212]: pam_unix(sudo:session): session closed for user root Sep 10 15:16:50 devstack cinder-volume[82800]: INFO oslo.privsep.daemon [req-5785295d-8658-4da3-bafa-bce33772f0cd req-1bb0fdbc-2fec-4222-959f-9945ef6120c8 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Spawned new privsep daemon via rootwrap Sep 10 15:16:50 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [req-5785295d-8658-4da3-bafa-bce33772f0cd req-1bb0fdbc-2fec-4222-959f-9945ef6120c8 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Accepted privsep connection to /tmp/tmpz71npaap/privsep.sock {{(pid=82800) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}} Sep 10 15:16:50 devstack cinder-volume[82800]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 10 15:16:50 devstack cinder-volume[82800]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 10 15:16:50 devstack cinder-volume[82800]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 10 15:16:50 devstack cinder-volume[82800]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84297 Sep 10 15:16:50 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[46118f4c-7754-472f-8269-8767436933ad]: (2,) {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:16:50 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cadc4ab-93e1-4640-bb3a-aed49d281a3b]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:16:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-5785295d-8658-4da3-bafa-bce33772f0cd req-1bb0fdbc-2fec-4222-959f-9945ef6120c8 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9c9b0113-bda3-4fbe-8e94-edafdac97c32 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:16:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-5785295d-8658-4da3-bafa-bce33772f0cd req-1bb0fdbc-2fec-4222-959f-9945ef6120c8 tempest-VolumesAssistedSnapshotsTest-1124771453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9c9b0113-bda3-4fbe-8e94-edafdac97c32" returned: 0 in 0.399s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:16:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-5785295d-8658-4da3-bafa-bce33772f0cd req-1bb0fdbc-2fec-4222-959f-9945ef6120c8 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 8.287s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:16:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-ea58ed99-f7da-483b-93f9-6e417a5a627f req-876c1b9b-b17b-42bc-961a-c5976c2a31e1 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.386s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:16:51 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d478f04-41c2-465d-89d9-05f2ab9f5a19]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:16:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-ea58ed99-f7da-483b-93f9-6e417a5a627f req-876c1b9b-b17b-42bc-961a-c5976c2a31e1 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-a355e809-bde8-4d5e-b306-7a199fc66ad5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:16:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-5785295d-8658-4da3-bafa-bce33772f0cd req-1bb0fdbc-2fec-4222-959f-9945ef6120c8 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5', 'name': 'volume-9c9b0113-bda3-4fbe-8e94-edafdac97c32', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f5141c67-d07b-4778-bf6b-1680dead09d4', 'enforce_multipath': True} {{(pid=82800) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 15:16:51 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-5785295d-8658-4da3-bafa-bce33772f0cd req-1bb0fdbc-2fec-4222-959f-9945ef6120c8 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:16:51 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-5785295d-8658-4da3-bafa-bce33772f0cd req-1bb0fdbc-2fec-4222-959f-9945ef6120c8 tempest-VolumesAssistedSnapshotsTest-1124771453 None] attachment_update completed successfully. Sep 10 15:16:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-ea58ed99-f7da-483b-93f9-6e417a5a627f req-876c1b9b-b17b-42bc-961a-c5976c2a31e1 tempest-AttachSCSIVolumeTestJSON-1251632728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-a355e809-bde8-4d5e-b306-7a199fc66ad5" returned: 0 in 0.632s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:16:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-ea58ed99-f7da-483b-93f9-6e417a5a627f req-876c1b9b-b17b-42bc-961a-c5976c2a31e1 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.702s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:16:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-ea58ed99-f7da-483b-93f9-6e417a5a627f req-876c1b9b-b17b-42bc-961a-c5976c2a31e1 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5', 'name': 'volume-a355e809-bde8-4d5e-b306-7a199fc66ad5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '79bc2319-90cb-4a1c-b17d-9767c2b2a9b6', 'enforce_multipath': True} {{(pid=82800) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 15:16:51 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-ea58ed99-f7da-483b-93f9-6e417a5a627f req-876c1b9b-b17b-42bc-961a-c5976c2a31e1 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:16:51 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-ea58ed99-f7da-483b-93f9-6e417a5a627f req-876c1b9b-b17b-42bc-961a-c5976c2a31e1 tempest-AttachSCSIVolumeTestJSON-1251632728 None] attachment_update completed successfully. Sep 10 15:16:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-910d8c11-95b1-4a68-9407-f8ef5cdb52e0 req-d75ee1dd-b587-4271-9db8-ab9032948748 tempest-TaggedAttachmentsTest-1500355993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:16:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-910d8c11-95b1-4a68-9407-f8ef5cdb52e0 req-d75ee1dd-b587-4271-9db8-ab9032948748 tempest-TaggedAttachmentsTest-1500355993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:16:56 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f94b98-77d7-4ca1-b311-ac6b221e2124]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:16:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-910d8c11-95b1-4a68-9407-f8ef5cdb52e0 req-d75ee1dd-b587-4271-9db8-ab9032948748 tempest-TaggedAttachmentsTest-1500355993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-738faa19-6029-4f6e-a754-58ecb5f415b9 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:16:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-910d8c11-95b1-4a68-9407-f8ef5cdb52e0 req-d75ee1dd-b587-4271-9db8-ab9032948748 tempest-TaggedAttachmentsTest-1500355993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-738faa19-6029-4f6e-a754-58ecb5f415b9" returned: 0 in 0.450s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:16:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-910d8c11-95b1-4a68-9407-f8ef5cdb52e0 req-d75ee1dd-b587-4271-9db8-ab9032948748 tempest-TaggedAttachmentsTest-1500355993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.500s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:16:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-910d8c11-95b1-4a68-9407-f8ef5cdb52e0 req-d75ee1dd-b587-4271-9db8-ab9032948748 tempest-TaggedAttachmentsTest-1500355993 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5', 'name': 'volume-738faa19-6029-4f6e-a754-58ecb5f415b9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d257a98-bb3f-47a8-91e3-0e7a15059cd3', 'enforce_multipath': True} {{(pid=82800) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 15:16:56 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-910d8c11-95b1-4a68-9407-f8ef5cdb52e0 req-d75ee1dd-b587-4271-9db8-ab9032948748 tempest-TaggedAttachmentsTest-1500355993 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:16:57 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-910d8c11-95b1-4a68-9407-f8ef5cdb52e0 req-d75ee1dd-b587-4271-9db8-ab9032948748 tempest-TaggedAttachmentsTest-1500355993 None] attachment_update completed successfully. Sep 10 15:17:07 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=17,cinder:UPDATE=4 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:17:07 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=17,cinder:UPDATE=6 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:17:20 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-1c8c5a9c-901d-4413-a456-075ec37e0dae req-adc2c26a-5f7a-46f2-866a-12d4389e7ed4 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:17:20 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-1c8c5a9c-901d-4413-a456-075ec37e0dae req-adc2c26a-5f7a-46f2-866a-12d4389e7ed4 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:17:20 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-1c8c5a9c-901d-4413-a456-075ec37e0dae req-adc2c26a-5f7a-46f2-866a-12d4389e7ed4 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Terminate volume connection completed successfully. Sep 10 15:17:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-1c8c5a9c-901d-4413-a456-075ec37e0dae req-adc2c26a-5f7a-46f2-866a-12d4389e7ed4 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Deleting attachment 79bc2319-90cb-4a1c-b17d-9767c2b2a9b6. {{(pid=82800) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 15:17:21 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-ca2a25e7-fddd-4521-9f11-1803c96d4db9 req-0bf59620-2866-4df3-8a45-f75c298e92d8 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:17:21 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-ca2a25e7-fddd-4521-9f11-1803c96d4db9 req-0bf59620-2866-4df3-8a45-f75c298e92d8 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:17:21 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-ca2a25e7-fddd-4521-9f11-1803c96d4db9 req-0bf59620-2866-4df3-8a45-f75c298e92d8 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Terminate volume connection completed successfully. Sep 10 15:17:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-ca2a25e7-fddd-4521-9f11-1803c96d4db9 req-0bf59620-2866-4df3-8a45-f75c298e92d8 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Deleting attachment f5141c67-d07b-4778-bf6b-1680dead09d4. {{(pid=82800) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 15:17:23 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-de8fb39e-b150-496e-a59a-dc37436f96f6 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Acquiring lock "cinder-9c9b0113-bda3-4fbe-8e94-edafdac97c32-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:17:23 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-de8fb39e-b150-496e-a59a-dc37436f96f6 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Lock "cinder-9c9b0113-bda3-4fbe-8e94-edafdac97c32-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:17:23 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-de8fb39e-b150-496e-a59a-dc37436f96f6 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:17:23 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-de8fb39e-b150-496e-a59a-dc37436f96f6 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Acquiring lock "cinder-quobyte-9c9b0113-bda3-4fbe-8e94-edafdac97c32" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:17:23 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-de8fb39e-b150-496e-a59a-dc37436f96f6 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Lock "cinder-quobyte-9c9b0113-bda3-4fbe-8e94-edafdac97c32" acquired by "delete_volume" :: waited 0.016s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:17:23 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[933b7b62-e1fb-4bf9-bf52-01ddb91c345c]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:17:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-de8fb39e-b150-496e-a59a-dc37436f96f6 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9c9b0113-bda3-4fbe-8e94-edafdac97c32 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:17:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-de8fb39e-b150-496e-a59a-dc37436f96f6 tempest-VolumesAssistedSnapshotsTest-1124771453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9c9b0113-bda3-4fbe-8e94-edafdac97c32" returned: 0 in 0.767s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:17:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-de8fb39e-b150-496e-a59a-dc37436f96f6 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9c9b0113-bda3-4fbe-8e94-edafdac97c32 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:17:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-de8fb39e-b150-496e-a59a-dc37436f96f6 tempest-VolumesAssistedSnapshotsTest-1124771453 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9c9b0113-bda3-4fbe-8e94-edafdac97c32" returned: 0 in 0.104s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:17:25 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-de8fb39e-b150-496e-a59a-dc37436f96f6 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Lock "cinder-quobyte-9c9b0113-bda3-4fbe-8e94-edafdac97c32" released by "delete_volume" :: held 1.517s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:17:25 devstack cinder-volume[82800]: WARNING cinder.quota [None req-de8fb39e-b150-496e-a59a-dc37436f96f6 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:17:25 devstack cinder-volume[82800]: WARNING cinder.quota [None req-de8fb39e-b150-496e-a59a-dc37436f96f6 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:17:25 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-de8fb39e-b150-496e-a59a-dc37436f96f6 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Created reservations ['3933978f-a1b7-481a-b5f8-b2498d2ee5d8', 'c80d638e-b64b-4832-80f7-e450f461af65', 'b41304b5-54e0-4411-ae07-86063d3c7762', 'f4f1a05e-67ed-444c-a702-84a627b23889'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:17:26 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-82b5e6a2-bb4c-4eca-9fd6-e6bef8e43b1b req-a3d33ac4-aa5a-42d6-b11c-eb4b078f0cee tempest-TaggedAttachmentsTest-1500355993 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:17:26 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-82b5e6a2-bb4c-4eca-9fd6-e6bef8e43b1b req-a3d33ac4-aa5a-42d6-b11c-eb4b078f0cee tempest-TaggedAttachmentsTest-1500355993 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:17:26 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-82b5e6a2-bb4c-4eca-9fd6-e6bef8e43b1b req-a3d33ac4-aa5a-42d6-b11c-eb4b078f0cee tempest-TaggedAttachmentsTest-1500355993 None] Terminate volume connection completed successfully. Sep 10 15:17:26 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-82b5e6a2-bb4c-4eca-9fd6-e6bef8e43b1b req-a3d33ac4-aa5a-42d6-b11c-eb4b078f0cee tempest-TaggedAttachmentsTest-1500355993 None] Deleting attachment 6d257a98-bb3f-47a8-91e3-0e7a15059cd3. {{(pid=82800) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 15:17:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-de8fb39e-b150-496e-a59a-dc37436f96f6 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:17:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-de8fb39e-b150-496e-a59a-dc37436f96f6 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:17:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-de8fb39e-b150-496e-a59a-dc37436f96f6 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:17:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-de8fb39e-b150-496e-a59a-dc37436f96f6 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:17:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-de8fb39e-b150-496e-a59a-dc37436f96f6 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:17:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-de8fb39e-b150-496e-a59a-dc37436f96f6 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:17:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-de8fb39e-b150-496e-a59a-dc37436f96f6 tempest-VolumesAssistedSnapshotsTest-1124771453 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.085s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:17:26 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-de8fb39e-b150-496e-a59a-dc37436f96f6 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:17:26 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-de8fb39e-b150-496e-a59a-dc37436f96f6 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Deleted volume successfully. Sep 10 15:17:26 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-de8fb39e-b150-496e-a59a-dc37436f96f6 tempest-VolumesAssistedSnapshotsTest-1124771453 None] Lock "cinder-9c9b0113-bda3-4fbe-8e94-edafdac97c32-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:17:28 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:17:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:17:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:17:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:17:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:17:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.075s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:17:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:17:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.518s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:17:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:17:36 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=8,cinder:UPDATE=9,cinder:INSERT=4 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:17:36 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=8,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:17:38 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-dc23f7a8-fbdb-4815-b947-de001bae8fd0 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Acquiring lock "cinder-a355e809-bde8-4d5e-b306-7a199fc66ad5-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:17:38 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-dc23f7a8-fbdb-4815-b947-de001bae8fd0 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Lock "cinder-a355e809-bde8-4d5e-b306-7a199fc66ad5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:17:38 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-dc23f7a8-fbdb-4815-b947-de001bae8fd0 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:17:38 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-dc23f7a8-fbdb-4815-b947-de001bae8fd0 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Acquiring lock "cinder-quobyte-a355e809-bde8-4d5e-b306-7a199fc66ad5" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:17:38 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-dc23f7a8-fbdb-4815-b947-de001bae8fd0 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Lock "cinder-quobyte-a355e809-bde8-4d5e-b306-7a199fc66ad5" acquired by "delete_volume" :: waited 0.016s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:17:38 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9ea00a-6a66-448f-9fa7-58e7129130db]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:17:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-dc23f7a8-fbdb-4815-b947-de001bae8fd0 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-a355e809-bde8-4d5e-b306-7a199fc66ad5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:17:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-dc23f7a8-fbdb-4815-b947-de001bae8fd0 tempest-AttachSCSIVolumeTestJSON-1251632728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-a355e809-bde8-4d5e-b306-7a199fc66ad5" returned: 0 in 0.499s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:17:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-dc23f7a8-fbdb-4815-b947-de001bae8fd0 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-a355e809-bde8-4d5e-b306-7a199fc66ad5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:17:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-dc23f7a8-fbdb-4815-b947-de001bae8fd0 tempest-AttachSCSIVolumeTestJSON-1251632728 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-a355e809-bde8-4d5e-b306-7a199fc66ad5" returned: 0 in 0.075s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:17:39 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-dc23f7a8-fbdb-4815-b947-de001bae8fd0 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Lock "cinder-quobyte-a355e809-bde8-4d5e-b306-7a199fc66ad5" released by "delete_volume" :: held 0.741s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:17:39 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-dc23f7a8-fbdb-4815-b947-de001bae8fd0 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Created reservations ['d2ae291e-7129-4ce3-95a1-fbb76eb9e241', '5afcb6ab-8c14-4d64-92cf-66422ee49e50', 'd24d6964-9832-4e56-a2d7-809580dd2b4a', '07867ff2-68d6-4a6f-93ec-12d6911f4b43'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:17:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-dc23f7a8-fbdb-4815-b947-de001bae8fd0 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:17:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-dc23f7a8-fbdb-4815-b947-de001bae8fd0 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:17:39 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-dc23f7a8-fbdb-4815-b947-de001bae8fd0 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:17:39 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-dc23f7a8-fbdb-4815-b947-de001bae8fd0 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:17:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-dc23f7a8-fbdb-4815-b947-de001bae8fd0 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:17:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-dc23f7a8-fbdb-4815-b947-de001bae8fd0 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:17:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-dc23f7a8-fbdb-4815-b947-de001bae8fd0 tempest-AttachSCSIVolumeTestJSON-1251632728 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.095s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:17:40 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-dc23f7a8-fbdb-4815-b947-de001bae8fd0 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:17:40 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-dc23f7a8-fbdb-4815-b947-de001bae8fd0 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Deleted volume successfully. Sep 10 15:17:40 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-dc23f7a8-fbdb-4815-b947-de001bae8fd0 tempest-AttachSCSIVolumeTestJSON-1251632728 None] Lock "cinder-a355e809-bde8-4d5e-b306-7a199fc66ad5-delete_volume" released by "delete_volume" :: held 1.908s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:17:49 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=9 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:17:50 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=7,cinder:SELECT=4,cinder:INSERT=3,cinder:DELETE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:18:19 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d8d81e8c-2a8d-4c23-b8d1-7226fd8587ef tempest-TaggedAttachmentsTest-1500355993 None] Acquiring lock "cinder-738faa19-6029-4f6e-a754-58ecb5f415b9-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:18:19 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d8d81e8c-2a8d-4c23-b8d1-7226fd8587ef tempest-TaggedAttachmentsTest-1500355993 None] Lock "cinder-738faa19-6029-4f6e-a754-58ecb5f415b9-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:18:19 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-d8d81e8c-2a8d-4c23-b8d1-7226fd8587ef tempest-TaggedAttachmentsTest-1500355993 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:18:19 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d8d81e8c-2a8d-4c23-b8d1-7226fd8587ef tempest-TaggedAttachmentsTest-1500355993 None] Acquiring lock "cinder-quobyte-738faa19-6029-4f6e-a754-58ecb5f415b9" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:18:19 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d8d81e8c-2a8d-4c23-b8d1-7226fd8587ef tempest-TaggedAttachmentsTest-1500355993 None] Lock "cinder-quobyte-738faa19-6029-4f6e-a754-58ecb5f415b9" acquired by "delete_volume" :: waited 0.015s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:18:19 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee80d9d-1100-42b5-ba05-7cd13a4854b1]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:18:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8d81e8c-2a8d-4c23-b8d1-7226fd8587ef tempest-TaggedAttachmentsTest-1500355993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-738faa19-6029-4f6e-a754-58ecb5f415b9 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:18:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8d81e8c-2a8d-4c23-b8d1-7226fd8587ef tempest-TaggedAttachmentsTest-1500355993 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-738faa19-6029-4f6e-a754-58ecb5f415b9" returned: 0 in 0.632s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:18:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8d81e8c-2a8d-4c23-b8d1-7226fd8587ef tempest-TaggedAttachmentsTest-1500355993 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-738faa19-6029-4f6e-a754-58ecb5f415b9 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:18:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8d81e8c-2a8d-4c23-b8d1-7226fd8587ef tempest-TaggedAttachmentsTest-1500355993 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-738faa19-6029-4f6e-a754-58ecb5f415b9" returned: 0 in 0.141s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:18:20 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d8d81e8c-2a8d-4c23-b8d1-7226fd8587ef tempest-TaggedAttachmentsTest-1500355993 None] Lock "cinder-quobyte-738faa19-6029-4f6e-a754-58ecb5f415b9" released by "delete_volume" :: held 0.990s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:18:20 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-d8d81e8c-2a8d-4c23-b8d1-7226fd8587ef tempest-TaggedAttachmentsTest-1500355993 None] Created reservations ['2fc3c26e-be93-439c-9c84-526012725821', 'ba6b67a9-a75d-4ba6-a2aa-e7b3b140c12b', 'bc56c9ed-7bbb-4b0d-bbd2-c2b3d2198d09', 'd81667d7-4a34-4957-bbea-08b467544907'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:18:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d8d81e8c-2a8d-4c23-b8d1-7226fd8587ef tempest-TaggedAttachmentsTest-1500355993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:18:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d8d81e8c-2a8d-4c23-b8d1-7226fd8587ef tempest-TaggedAttachmentsTest-1500355993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:18:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d8d81e8c-2a8d-4c23-b8d1-7226fd8587ef tempest-TaggedAttachmentsTest-1500355993 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:18:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d8d81e8c-2a8d-4c23-b8d1-7226fd8587ef tempest-TaggedAttachmentsTest-1500355993 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:18:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d8d81e8c-2a8d-4c23-b8d1-7226fd8587ef tempest-TaggedAttachmentsTest-1500355993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:18:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8d81e8c-2a8d-4c23-b8d1-7226fd8587ef tempest-TaggedAttachmentsTest-1500355993 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:18:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8d81e8c-2a8d-4c23-b8d1-7226fd8587ef tempest-TaggedAttachmentsTest-1500355993 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.094s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:18:21 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-d8d81e8c-2a8d-4c23-b8d1-7226fd8587ef tempest-TaggedAttachmentsTest-1500355993 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:18:21 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-d8d81e8c-2a8d-4c23-b8d1-7226fd8587ef tempest-TaggedAttachmentsTest-1500355993 None] Deleted volume successfully. Sep 10 15:18:21 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d8d81e8c-2a8d-4c23-b8d1-7226fd8587ef tempest-TaggedAttachmentsTest-1500355993 None] Lock "cinder-738faa19-6029-4f6e-a754-58ecb5f415b9-delete_volume" released by "delete_volume" :: held 2.147s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:18:28 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:18:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:18:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:18:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:18:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:18:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:18:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:18:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.186s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:18:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:18:31 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=6 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:18:31 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=10,cinder:SELECT=5,cinder:INSERT=3,cinder:DELETE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:19:08 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:19:08 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:19:10 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:19:10 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:19:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Flow 'volume_create_manager' (b75e58b2-2660-4cb8-aa50-ed94bcbd2079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:19:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed46be8d-199d-457b-ba81-fc9e5edb5221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:19:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed46be8d-199d-457b-ba81-fc9e5edb5221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2117374790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=466eb1c2-e099-455b-88a3-1a6ec0018c49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b358b3612c3e448fad4513cb66eca1fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:19:11Z,use_quota=True,user_id='1925d61e13784115ac0e1032f559f3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:19:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (729c9b58-7256-4563-b049-a400d44e07e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:19:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (729c9b58-7256-4563-b049-a400d44e07e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:19:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b32106-cc36-48ee-9ee1-5390b1eb0701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:19:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b32106-cc36-48ee-9ee1-5390b1eb0701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '466eb1c2-e099-455b-88a3-1a6ec0018c49', 'volume_name': 'volume-466eb1c2-e099-455b-88a3-1a6ec0018c49', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:19:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (380bc791-36ae-47c8-b95e-edaa80525dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:19:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (380bc791-36ae-47c8-b95e-edaa80525dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:19:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce3fa264-eb8f-4d77-abd2-9fdc672b5182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:19:11 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Volume 466eb1c2-e099-455b-88a3-1a6ec0018c49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-466eb1c2-e099-455b-88a3-1a6ec0018c49', 'volume_size': 1} Sep 10 15:19:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:19:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:19:11 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2117374790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=466eb1c2-e099-455b-88a3-1a6ec0018c49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b358b3612c3e448fad4513cb66eca1fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:19:11Z,use_quota=True,user_id='1925d61e13784115ac0e1032f559f3ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:19:11 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Creating volume 466eb1c2-e099-455b-88a3-1a6ec0018c49 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:19:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:19:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:19:11 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:19:11 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:19:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:19:11 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:19:11 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:19:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-466eb1c2-e099-455b-88a3-1a6ec0018c49 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:19:11 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=5, name=volume-466eb1c2-e099-455b-88a3-1a6ec0018c49, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:19:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-466eb1c2-e099-455b-88a3-1a6ec0018c49 1073741824" returned: 0 in 0.727s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:19:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-466eb1c2-e099-455b-88a3-1a6ec0018c49 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:19:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-466eb1c2-e099-455b-88a3-1a6ec0018c49" returned: 0 in 0.200s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:19:12 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] <== create_volume: return (1047ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:19:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:19:12 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce3fa264-eb8f-4d77-abd2-9fdc672b5182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-466eb1c2-e099-455b-88a3-1a6ec0018c49', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:19:12 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0813754-b686-4aec-bed3-c8e39ad0e229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:19:12 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Volume volume-466eb1c2-e099-455b-88a3-1a6ec0018c49 (466eb1c2-e099-455b-88a3-1a6ec0018c49): created successfully Sep 10 15:19:12 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0813754-b686-4aec-bed3-c8e39ad0e229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:19:12 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Flow 'volume_create_manager' (b75e58b2-2660-4cb8-aa50-ed94bcbd2079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:19:12 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-b4d7a075-5fe2-4f58-b0e6-ee1a4ac0d5da tempest-DeleteServersTestJSON-378981719 None] Created volume successfully. Sep 10 15:19:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-b7584ca1-91ee-40fe-9799-a6e4ffd73380 req-0dc43448-5661-4136-8cd7-ca6c2eafc9e3 tempest-DeleteServersTestJSON-378981719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:19:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-b7584ca1-91ee-40fe-9799-a6e4ffd73380 req-0dc43448-5661-4136-8cd7-ca6c2eafc9e3 tempest-DeleteServersTestJSON-378981719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:19:19 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48637ca-3430-4fac-a799-bdd51f9ba5c3]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:19:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-b7584ca1-91ee-40fe-9799-a6e4ffd73380 req-0dc43448-5661-4136-8cd7-ca6c2eafc9e3 tempest-DeleteServersTestJSON-378981719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-466eb1c2-e099-455b-88a3-1a6ec0018c49 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:19:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-b7584ca1-91ee-40fe-9799-a6e4ffd73380 req-0dc43448-5661-4136-8cd7-ca6c2eafc9e3 tempest-DeleteServersTestJSON-378981719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-466eb1c2-e099-455b-88a3-1a6ec0018c49" returned: 0 in 0.817s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:19:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-b7584ca1-91ee-40fe-9799-a6e4ffd73380 req-0dc43448-5661-4136-8cd7-ca6c2eafc9e3 tempest-DeleteServersTestJSON-378981719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.936s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:19:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-b7584ca1-91ee-40fe-9799-a6e4ffd73380 req-0dc43448-5661-4136-8cd7-ca6c2eafc9e3 tempest-DeleteServersTestJSON-378981719 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5', 'name': 'volume-466eb1c2-e099-455b-88a3-1a6ec0018c49', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bbcd3903-fbb1-4f00-8371-99b1c02cb966', 'enforce_multipath': True} {{(pid=82800) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 15:19:21 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-b7584ca1-91ee-40fe-9799-a6e4ffd73380 req-0dc43448-5661-4136-8cd7-ca6c2eafc9e3 tempest-DeleteServersTestJSON-378981719 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:19:21 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-b7584ca1-91ee-40fe-9799-a6e4ffd73380 req-0dc43448-5661-4136-8cd7-ca6c2eafc9e3 tempest-DeleteServersTestJSON-378981719 None] attachment_update completed successfully. Sep 10 15:19:28 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:19:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:19:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:19:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:19:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:19:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:19:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:19:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.287s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:19:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:19:31 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=3,cinder:SELECT=7 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:19:31 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:19:37 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-4b279d37-cbc9-4343-a755-e03300bc25c2 req-7d540b41-eb12-45dc-a5c2-f881a4d6cb47 tempest-DeleteServersTestJSON-378981719 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:19:38 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-4b279d37-cbc9-4343-a755-e03300bc25c2 req-7d540b41-eb12-45dc-a5c2-f881a4d6cb47 tempest-DeleteServersTestJSON-378981719 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:19:38 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-4b279d37-cbc9-4343-a755-e03300bc25c2 req-7d540b41-eb12-45dc-a5c2-f881a4d6cb47 tempest-DeleteServersTestJSON-378981719 None] Terminate volume connection completed successfully. Sep 10 15:19:38 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-4b279d37-cbc9-4343-a755-e03300bc25c2 req-7d540b41-eb12-45dc-a5c2-f881a4d6cb47 tempest-DeleteServersTestJSON-378981719 None] Deleting attachment bbcd3903-fbb1-4f00-8371-99b1c02cb966. {{(pid=82800) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 15:19:48 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:19:48 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:19:49 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-f84fadd3-3ee6-4c9c-9bac-16a1adfe40fa tempest-DeleteServersTestJSON-378981719 None] Acquiring lock "cinder-466eb1c2-e099-455b-88a3-1a6ec0018c49-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:19:49 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-f84fadd3-3ee6-4c9c-9bac-16a1adfe40fa tempest-DeleteServersTestJSON-378981719 None] Lock "cinder-466eb1c2-e099-455b-88a3-1a6ec0018c49-delete_volume" acquired by "delete_volume" :: waited 0.146s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:19:50 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-f84fadd3-3ee6-4c9c-9bac-16a1adfe40fa tempest-DeleteServersTestJSON-378981719 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:19:50 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-f84fadd3-3ee6-4c9c-9bac-16a1adfe40fa tempest-DeleteServersTestJSON-378981719 None] Acquiring lock "cinder-quobyte-466eb1c2-e099-455b-88a3-1a6ec0018c49" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:19:50 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-f84fadd3-3ee6-4c9c-9bac-16a1adfe40fa tempest-DeleteServersTestJSON-378981719 None] Lock "cinder-quobyte-466eb1c2-e099-455b-88a3-1a6ec0018c49" acquired by "delete_volume" :: waited 0.059s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:19:50 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a22ca0b-4fea-45d0-8d8e-b24aa9dce4ba]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:19:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f84fadd3-3ee6-4c9c-9bac-16a1adfe40fa tempest-DeleteServersTestJSON-378981719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-466eb1c2-e099-455b-88a3-1a6ec0018c49 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:19:51 devstack quobyte-client[82814]: System call of process 85886 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:19:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f84fadd3-3ee6-4c9c-9bac-16a1adfe40fa tempest-DeleteServersTestJSON-378981719 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-466eb1c2-e099-455b-88a3-1a6ec0018c49" returned: 0 in 1.473s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:19:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f84fadd3-3ee6-4c9c-9bac-16a1adfe40fa tempest-DeleteServersTestJSON-378981719 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-466eb1c2-e099-455b-88a3-1a6ec0018c49 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:19:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f84fadd3-3ee6-4c9c-9bac-16a1adfe40fa tempest-DeleteServersTestJSON-378981719 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-466eb1c2-e099-455b-88a3-1a6ec0018c49" returned: 0 in 0.328s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:19:52 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-f84fadd3-3ee6-4c9c-9bac-16a1adfe40fa tempest-DeleteServersTestJSON-378981719 None] Lock "cinder-quobyte-466eb1c2-e099-455b-88a3-1a6ec0018c49" released by "delete_volume" :: held 2.306s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:19:53 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-f84fadd3-3ee6-4c9c-9bac-16a1adfe40fa tempest-DeleteServersTestJSON-378981719 None] Created reservations ['3c235fc3-c6bf-401a-ae5f-1ded1a8fb999', '17b32ad1-e3f1-4449-b4ae-5fa1c78893cb', 'b8818350-ad19-4a58-9127-bcef183e5bd3', '80008344-e864-49ef-a919-9b59d0a379ba'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:19:53 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:19:53 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:19:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Flow 'volume_create_manager' (4db53d9c-33f3-4849-bec8-803ef4802aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:19:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fa9ca81-2fce-4787-9f2f-b7b02d80c4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:19:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fa9ca81-2fce-4787-9f2f-b7b02d80c4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-158803849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a65bf11d-67a2-4029-997d-1a48d67b558e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddeb213911df4814af5b2372ea638244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:19:53Z,use_quota=True,user_id='f73e58286c9a419aa51e69bc7ceb0393',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:19:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068a45f5-7f68-4260-9fa7-df1d46ee59e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:19:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068a45f5-7f68-4260-9fa7-df1d46ee59e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:19:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5789b2cf-6ae9-4ae1-bbb8-4208be8eb030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:19:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5789b2cf-6ae9-4ae1-bbb8-4208be8eb030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a65bf11d-67a2-4029-997d-1a48d67b558e', 'volume_name': 'volume-a65bf11d-67a2-4029-997d-1a48d67b558e', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:19:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e0bb8f4-decb-4a67-8c63-bbb02442f37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:19:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e0bb8f4-decb-4a67-8c63-bbb02442f37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:19:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edca660b-4873-4fb7-9ed4-0b4ee9f7a19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:19:54 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Volume a65bf11d-67a2-4029-997d-1a48d67b558e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a65bf11d-67a2-4029-997d-1a48d67b558e', 'volume_size': 1} Sep 10 15:19:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:19:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:19:54 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-158803849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a65bf11d-67a2-4029-997d-1a48d67b558e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddeb213911df4814af5b2372ea638244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:19:53Z,use_quota=True,user_id='f73e58286c9a419aa51e69bc7ceb0393',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:19:54 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Creating volume a65bf11d-67a2-4029-997d-1a48d67b558e {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:19:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:19:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:19:54 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:19:54 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:19:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:19:54 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:19:54 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:19:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-a65bf11d-67a2-4029-997d-1a48d67b558e 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:19:54 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=6, name=volume-a65bf11d-67a2-4029-997d-1a48d67b558e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:19:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-a65bf11d-67a2-4029-997d-1a48d67b558e 1073741824" returned: 0 in 0.851s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:19:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-a65bf11d-67a2-4029-997d-1a48d67b558e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:19:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f84fadd3-3ee6-4c9c-9bac-16a1adfe40fa tempest-DeleteServersTestJSON-378981719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:19:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f84fadd3-3ee6-4c9c-9bac-16a1adfe40fa tempest-DeleteServersTestJSON-378981719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.044s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:19:55 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f84fadd3-3ee6-4c9c-9bac-16a1adfe40fa tempest-DeleteServersTestJSON-378981719 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:19:55 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f84fadd3-3ee6-4c9c-9bac-16a1adfe40fa tempest-DeleteServersTestJSON-378981719 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:19:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f84fadd3-3ee6-4c9c-9bac-16a1adfe40fa tempest-DeleteServersTestJSON-378981719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:19:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f84fadd3-3ee6-4c9c-9bac-16a1adfe40fa tempest-DeleteServersTestJSON-378981719 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:19:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-a65bf11d-67a2-4029-997d-1a48d67b558e" returned: 0 in 0.575s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:19:55 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] <== create_volume: return (1558ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:19:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:19:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edca660b-4873-4fb7-9ed4-0b4ee9f7a19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a65bf11d-67a2-4029-997d-1a48d67b558e', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:19:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (311b06e9-8eed-4fbd-a71b-04fafd7419f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:19:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f84fadd3-3ee6-4c9c-9bac-16a1adfe40fa tempest-DeleteServersTestJSON-378981719 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 1.231s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:19:56 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-f84fadd3-3ee6-4c9c-9bac-16a1adfe40fa tempest-DeleteServersTestJSON-378981719 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:19:56 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-f84fadd3-3ee6-4c9c-9bac-16a1adfe40fa tempest-DeleteServersTestJSON-378981719 None] Deleted volume successfully. Sep 10 15:19:56 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Volume volume-a65bf11d-67a2-4029-997d-1a48d67b558e (a65bf11d-67a2-4029-997d-1a48d67b558e): created successfully Sep 10 15:19:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (311b06e9-8eed-4fbd-a71b-04fafd7419f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:19:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Flow 'volume_create_manager' (4db53d9c-33f3-4849-bec8-803ef4802aa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:19:57 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-f84fadd3-3ee6-4c9c-9bac-16a1adfe40fa tempest-DeleteServersTestJSON-378981719 None] Lock "cinder-466eb1c2-e099-455b-88a3-1a6ec0018c49-delete_volume" released by "delete_volume" :: held 7.294s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:19:57 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-53587f22-1ea8-476a-b343-ceb1811e4854 tempest-VolumesAdminNegativeTest-699326310 None] Created volume successfully. Sep 10 15:19:58 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c2039df1-0fe9-40c9-a26d-62f1dd6f04f2 tempest-VolumesAdminNegativeTest-699326310 None] Acquiring lock "cinder-a65bf11d-67a2-4029-997d-1a48d67b558e-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:19:59 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c2039df1-0fe9-40c9-a26d-62f1dd6f04f2 tempest-VolumesAdminNegativeTest-699326310 None] Lock "cinder-a65bf11d-67a2-4029-997d-1a48d67b558e-delete_volume" acquired by "delete_volume" :: waited 0.369s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:20:00 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-c2039df1-0fe9-40c9-a26d-62f1dd6f04f2 tempest-VolumesAdminNegativeTest-699326310 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:20:00 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c2039df1-0fe9-40c9-a26d-62f1dd6f04f2 tempest-VolumesAdminNegativeTest-699326310 None] Acquiring lock "cinder-quobyte-a65bf11d-67a2-4029-997d-1a48d67b558e" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:20:00 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c2039df1-0fe9-40c9-a26d-62f1dd6f04f2 tempest-VolumesAdminNegativeTest-699326310 None] Lock "cinder-quobyte-a65bf11d-67a2-4029-997d-1a48d67b558e" acquired by "delete_volume" :: waited 0.119s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:20:00 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db2cd26-63eb-4ff5-9a58-b839694f2909]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:20:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c2039df1-0fe9-40c9-a26d-62f1dd6f04f2 tempest-VolumesAdminNegativeTest-699326310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-a65bf11d-67a2-4029-997d-1a48d67b558e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:20:02 devstack quobyte-client[82814]: System call of process 85938 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:20:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c2039df1-0fe9-40c9-a26d-62f1dd6f04f2 tempest-VolumesAdminNegativeTest-699326310 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-a65bf11d-67a2-4029-997d-1a48d67b558e" returned: 0 in 2.607s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:20:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c2039df1-0fe9-40c9-a26d-62f1dd6f04f2 tempest-VolumesAdminNegativeTest-699326310 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-a65bf11d-67a2-4029-997d-1a48d67b558e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:20:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c2039df1-0fe9-40c9-a26d-62f1dd6f04f2 tempest-VolumesAdminNegativeTest-699326310 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-a65bf11d-67a2-4029-997d-1a48d67b558e" returned: 0 in 0.548s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:20:04 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c2039df1-0fe9-40c9-a26d-62f1dd6f04f2 tempest-VolumesAdminNegativeTest-699326310 None] Lock "cinder-quobyte-a65bf11d-67a2-4029-997d-1a48d67b558e" released by "delete_volume" :: held 4.058s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:20:05 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-c2039df1-0fe9-40c9-a26d-62f1dd6f04f2 tempest-VolumesAdminNegativeTest-699326310 None] Created reservations ['5c9d8d14-c230-4248-9c58-a8ec1d350d49', 'a3f4dc48-7b88-4cdb-8d00-b795c778a4b4', '716675ce-ed3d-4bfb-965f-61888c7b146f', 'c536a2bc-ccd9-4bc0-952a-52fef7c8c31e'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:20:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c2039df1-0fe9-40c9-a26d-62f1dd6f04f2 tempest-VolumesAdminNegativeTest-699326310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:20:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c2039df1-0fe9-40c9-a26d-62f1dd6f04f2 tempest-VolumesAdminNegativeTest-699326310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:20:06 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c2039df1-0fe9-40c9-a26d-62f1dd6f04f2 tempest-VolumesAdminNegativeTest-699326310 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:20:06 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c2039df1-0fe9-40c9-a26d-62f1dd6f04f2 tempest-VolumesAdminNegativeTest-699326310 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:20:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c2039df1-0fe9-40c9-a26d-62f1dd6f04f2 tempest-VolumesAdminNegativeTest-699326310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.080s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:20:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c2039df1-0fe9-40c9-a26d-62f1dd6f04f2 tempest-VolumesAdminNegativeTest-699326310 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:20:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c2039df1-0fe9-40c9-a26d-62f1dd6f04f2 tempest-VolumesAdminNegativeTest-699326310 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.482s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:20:07 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-c2039df1-0fe9-40c9-a26d-62f1dd6f04f2 tempest-VolumesAdminNegativeTest-699326310 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:20:08 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-c2039df1-0fe9-40c9-a26d-62f1dd6f04f2 tempest-VolumesAdminNegativeTest-699326310 None] Deleted volume successfully. Sep 10 15:20:10 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c2039df1-0fe9-40c9-a26d-62f1dd6f04f2 tempest-VolumesAdminNegativeTest-699326310 None] Lock "cinder-a65bf11d-67a2-4029-997d-1a48d67b558e-delete_volume" released by "delete_volume" :: held 10.988s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:20:16 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=8,cinder:UPDATE=14,cinder:INSERT=8,cinder:DELETE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:20:19 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=14,cinder:UPDATE=22,cinder:DELETE=2 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:20:28 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:20:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:20:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.024s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:20:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:20:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:20:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:20:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:20:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.218s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:20:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:20:57 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:20:57 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:20:57 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Flow 'volume_create_manager' (82b6f949-1311-4673-9095-3bdfae5e2012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:20:57 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf0abb91-a285-4732-b1e8-eb15ee95bfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:20:57 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf0abb91-a285-4732-b1e8-eb15ee95bfd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-412565514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d98163-b710-4748-a0a2-eaac6dd3c2c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0f304fce2944dafa78eb0a8b8088396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:20:57Z,use_quota=True,user_id='bc74cafe9b54486387c2aaccf911c233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:20:57 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aaab21e-83bc-4b05-a251-c694f7b452d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:20:57 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aaab21e-83bc-4b05-a251-c694f7b452d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:20:57 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93edb1ff-ec2c-4b42-86d6-f2650158f33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:20:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93edb1ff-ec2c-4b42-86d6-f2650158f33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '03d98163-b710-4748-a0a2-eaac6dd3c2c9', 'volume_name': 'volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9', 'volume_size': 1, 'image_id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd75fe9cbcc7343938450d0505f3f0f02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'created_at': datetime.datetime(2025, 9, 10, 13, 6, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 13, 6, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa69f997-7136-4bd6-b8ef-95a111ba2ea1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:20:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d117145e-cdf8-48d7-b15e-37e4ac16dc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:20:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d117145e-cdf8-48d7-b15e-37e4ac16dc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:20:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b85dc5-7d81-4942-a4b5-9c87189f5ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:20:58 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Volume 03d98163-b710-4748-a0a2-eaac6dd3c2c9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9', 'volume_size': 1, 'image_id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd75fe9cbcc7343938450d0505f3f0f02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'created_at': datetime.datetime(2025, 9, 10, 13, 6, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 13, 6, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa69f997-7136-4bd6-b8ef-95a111ba2ea1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 15:20:58 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Cloning 03d98163-b710-4748-a0a2-eaac6dd3c2c9 from image aa69f997-7136-4bd6-b8ef-95a111ba2ea1 at location (None, None). {{(pid=82800) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 15:20:59 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_3dxb8jnydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82800) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 15:20:59 devstack cinder-volume[82800]: INFO cinder.image.image_utils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Image download 20.69 MB at 20.59 MB/s Sep 10 15:20:59 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d5c09e-1efd-46ea-aa87-284ee994d723]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:20:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_3dxb8jnydevstack@QuobyteHD {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:21:00 devstack sudo[86137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_3dxb8jnydevstack@QuobyteHD Sep 10 15:21:00 devstack sudo[86137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:21:03 devstack sudo[86137]: pam_unix(sudo:session): session closed for user root Sep 10 15:21:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_3dxb8jnydevstack@QuobyteHD" returned: 0 in 3.354s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:21:03 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Temporary image aa69f997-7136-4bd6-b8ef-95a111ba2ea1 is fetched for user bc74cafe9b54486387c2aaccf911c233. {{(pid=82800) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 15:21:03 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6b1871-f31f-4048-b317-4042c584c1ed]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:21:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_3dxb8jnydevstack@QuobyteHD {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:21:04 devstack sudo[86158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_3dxb8jnydevstack@QuobyteHD Sep 10 15:21:04 devstack sudo[86158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:21:07 devstack sudo[86158]: pam_unix(sudo:session): session closed for user root Sep 10 15:21:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_3dxb8jnydevstack@QuobyteHD" returned: 0 in 3.123s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:21:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:21:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.020s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:21:07 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-412565514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d98163-b710-4748-a0a2-eaac6dd3c2c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0f304fce2944dafa78eb0a8b8088396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:20:57Z,use_quota=True,user_id='bc74cafe9b54486387c2aaccf911c233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:21:07 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Creating volume 03d98163-b710-4748-a0a2-eaac6dd3c2c9 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:21:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:21:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:21:07 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:21:07 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:21:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:21:07 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:21:07 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:21:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:21:07 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=7, name=volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:21:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9 1073741824" returned: 0 in 0.431s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:21:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:21:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9" returned: 0 in 0.107s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:21:07 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] <== create_volume: return (639ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:21:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:21:08 devstack cinder-volume[82800]: DEBUG cinder.volume.volume_utils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Attempting download of aa69f997-7136-4bd6-b8ef-95a111ba2ea1 ((None, None)) to volume 03d98163-b710-4748-a0a2-eaac6dd3c2c9. {{(pid=82800) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 15:21:08 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[41383fc8-9b08-404b-b9c6-7de6c41765d7]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:21:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_6lszet_s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:21:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_6lszet_s" returned: 0 in 0.966s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:21:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_6lszet_s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:21:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_6lszet_s" returned: 1 in 0.648s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:21:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_6lszet_s' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:21:10 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e49c867-2f74-4666-815e-77681b9b40e7]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:21:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_3dxb8jnydevstack@QuobyteHD {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:21:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_3dxb8jnydevstack@QuobyteHD" returned: 0 in 0.587s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:21:10 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] aa69f997-7136-4bd6-b8ef-95a111ba2ea1 was qcow2, converting to raw {{(pid=82800) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 15:21:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_3dxb8jnydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:21:11 devstack quobyte-client[82814]: System call of process 86179 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:21:11 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=7, name=volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:21:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_3dxb8jnydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9" returned: 0 in 1.825s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:21:12 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_3dxb8jnydevstack@QuobyteHD, size 112.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9 {{(pid=82800) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 15:21:12 devstack cinder-volume[82800]: INFO cinder.image.image_utils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Converted 112.00 MB image at 58.10 MB/s Sep 10 15:21:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:21:13 devstack quobyte-client[82814]: System call of process 86186 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:21:13 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9 1G" returned: 0 in 0.457s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:21:13 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c779715-2653-4b55-ae44-02b2477b2c7b]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:21:13 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:21:14 devstack quobyte-client[82814]: System call of process 86189 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:21:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9" returned: 0 in 0.796s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:21:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:21:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9" returned: 1 in 0.858s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:21:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:21:15 devstack cinder-volume[82800]: DEBUG cinder.volume.volume_utils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Downloaded image aa69f997-7136-4bd6-b8ef-95a111ba2ea1 ((None, None)) to volume 03d98163-b710-4748-a0a2-eaac6dd3c2c9 successfully. {{(pid=82800) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 15:21:15 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Temporary image aa69f997-7136-4bd6-b8ef-95a111ba2ea1 for user bc74cafe9b54486387c2aaccf911c233 is deleted. {{(pid=82800) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 15:21:15 devstack cinder-volume[82800]: DEBUG cinder.volume.volume_utils [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Marking volume 03d98163-b710-4748-a0a2-eaac6dd3c2c9 as bootable. {{(pid=82800) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 15:21:15 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Copying metadata from image aa69f997-7136-4bd6-b8ef-95a111ba2ea1 to 03d98163-b710-4748-a0a2-eaac6dd3c2c9. {{(pid=82800) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 15:21:15 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Creating volume glance metadata for volume 03d98163-b710-4748-a0a2-eaac6dd3c2c9 backed by image aa69f997-7136-4bd6-b8ef-95a111ba2ea1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82800) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 15:21:15 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b85dc5-7d81-4942-a4b5-9c87189f5ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9', 'volume_size': 1, 'image_id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd75fe9cbcc7343938450d0505f3f0f02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'created_at': datetime.datetime(2025, 9, 10, 13, 6, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 13, 6, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa69f997-7136-4bd6-b8ef-95a111ba2ea1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:21:15 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f965786-e38c-41ce-9296-573698d434d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:21:15 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Volume volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9 (03d98163-b710-4748-a0a2-eaac6dd3c2c9): created successfully Sep 10 15:21:15 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f965786-e38c-41ce-9296-573698d434d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:21:15 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Flow 'volume_create_manager' (82b6f949-1311-4673-9095-3bdfae5e2012) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:21:15 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-312433b7-d8c1-4b1c-909b-a6b56cb90c30 tempest-TaggedBootDevicesTest-1872382209 None] Created volume successfully. Sep 10 15:21:17 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:21:17 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:21:17 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Flow 'volume_create_manager' (9bb2faf6-dc37-4b27-8b9d-e8c27b5597ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:21:17 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019c548e-0a2c-4532-8246-57af90db1ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:21:17 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (019c548e-0a2c-4532-8246-57af90db1ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-637407386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4133ab57-e001-41d7-a964-78e4d1b3b5aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0f304fce2944dafa78eb0a8b8088396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:21:17Z,use_quota=True,user_id='bc74cafe9b54486387c2aaccf911c233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:21:17 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115666ef-84c4-4b90-abd8-8041ae3dc520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:21:17 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115666ef-84c4-4b90-abd8-8041ae3dc520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:21:17 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (121f60d7-d32d-450d-85fe-2bba78554713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:21:17 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (121f60d7-d32d-450d-85fe-2bba78554713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4133ab57-e001-41d7-a964-78e4d1b3b5aa', 'volume_name': 'volume-4133ab57-e001-41d7-a964-78e4d1b3b5aa', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:21:17 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b78149f6-4d1a-46db-81ca-87879cd6ea55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:21:17 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b78149f6-4d1a-46db-81ca-87879cd6ea55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:21:17 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a46760-7da8-4158-ae44-afed3052ac2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:21:17 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Volume 4133ab57-e001-41d7-a964-78e4d1b3b5aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4133ab57-e001-41d7-a964-78e4d1b3b5aa', 'volume_size': 1} Sep 10 15:21:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:21:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:21:17 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-637407386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4133ab57-e001-41d7-a964-78e4d1b3b5aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0f304fce2944dafa78eb0a8b8088396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:21:17Z,use_quota=True,user_id='bc74cafe9b54486387c2aaccf911c233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:21:17 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Creating volume 4133ab57-e001-41d7-a964-78e4d1b3b5aa {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:21:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:21:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:21:17 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:21:17 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:21:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:21:17 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:21:17 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:21:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4133ab57-e001-41d7-a964-78e4d1b3b5aa 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:21:18 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=8, name=volume-4133ab57-e001-41d7-a964-78e4d1b3b5aa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:21:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4133ab57-e001-41d7-a964-78e4d1b3b5aa 1073741824" returned: 0 in 0.574s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:21:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4133ab57-e001-41d7-a964-78e4d1b3b5aa {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:21:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4133ab57-e001-41d7-a964-78e4d1b3b5aa" returned: 0 in 0.210s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:21:18 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] <== create_volume: return (1002ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:21:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:21:19 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a46760-7da8-4158-ae44-afed3052ac2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4133ab57-e001-41d7-a964-78e4d1b3b5aa', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:21:19 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6788e83-3305-4ffe-9532-48a55455cdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:21:19 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Volume volume-4133ab57-e001-41d7-a964-78e4d1b3b5aa (4133ab57-e001-41d7-a964-78e4d1b3b5aa): created successfully Sep 10 15:21:19 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6788e83-3305-4ffe-9532-48a55455cdd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:21:19 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Flow 'volume_create_manager' (9bb2faf6-dc37-4b27-8b9d-e8c27b5597ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:21:19 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-723c4bb1-c730-4f79-830d-fe8a8221fd73 tempest-TaggedBootDevicesTest-1872382209 None] Created volume successfully. Sep 10 15:21:20 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:21:20 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:21:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Flow 'volume_create_manager' (cfaa4c19-2f82-47e9-afcf-7c52b44cc6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:21:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c0c11c-32d7-4075-82ab-0b3916cc63c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:21:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c0c11c-32d7-4075-82ab-0b3916cc63c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1548595317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=722b1a12-ba78-4e42-9d75-ec54e4cc93be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0f304fce2944dafa78eb0a8b8088396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:21:20Z,use_quota=True,user_id='bc74cafe9b54486387c2aaccf911c233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:21:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a08113-2595-48a9-a852-1e77f20f1c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:21:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a08113-2595-48a9-a852-1e77f20f1c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:21:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc104f57-9f76-495f-8db5-2cd40706030f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:21:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc104f57-9f76-495f-8db5-2cd40706030f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '722b1a12-ba78-4e42-9d75-ec54e4cc93be', 'volume_name': 'volume-722b1a12-ba78-4e42-9d75-ec54e4cc93be', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:21:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e47924cc-27d0-4ce6-95f8-fd32e1895d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:21:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e47924cc-27d0-4ce6-95f8-fd32e1895d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:21:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1063d2e4-3723-4bf0-85ce-766508b19710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:21:20 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Volume 722b1a12-ba78-4e42-9d75-ec54e4cc93be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-722b1a12-ba78-4e42-9d75-ec54e4cc93be', 'volume_size': 1} Sep 10 15:21:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:21:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:21:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1548595317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=722b1a12-ba78-4e42-9d75-ec54e4cc93be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0f304fce2944dafa78eb0a8b8088396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:21:20Z,use_quota=True,user_id='bc74cafe9b54486387c2aaccf911c233',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:21:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Creating volume 722b1a12-ba78-4e42-9d75-ec54e4cc93be {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:21:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:21:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:21:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:21:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:21:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:21:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:21:20 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:21:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-722b1a12-ba78-4e42-9d75-ec54e4cc93be 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:21:21 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=9, name=volume-722b1a12-ba78-4e42-9d75-ec54e4cc93be, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:21:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-722b1a12-ba78-4e42-9d75-ec54e4cc93be 1073741824" returned: 0 in 0.642s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:21:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-722b1a12-ba78-4e42-9d75-ec54e4cc93be {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:21:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-722b1a12-ba78-4e42-9d75-ec54e4cc93be" returned: 0 in 0.139s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:21:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] <== create_volume: return (891ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:21:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:21:22 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1063d2e4-3723-4bf0-85ce-766508b19710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-722b1a12-ba78-4e42-9d75-ec54e4cc93be', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:21:22 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ebf1f9-2aee-4755-9043-20fe142555d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:21:22 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Volume volume-722b1a12-ba78-4e42-9d75-ec54e4cc93be (722b1a12-ba78-4e42-9d75-ec54e4cc93be): created successfully Sep 10 15:21:22 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ebf1f9-2aee-4755-9043-20fe142555d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:21:22 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Flow 'volume_create_manager' (cfaa4c19-2f82-47e9-afcf-7c52b44cc6c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:21:22 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-2f66d68e-c634-4ddb-8186-418273b7ce75 tempest-TaggedBootDevicesTest-1872382209 None] Created volume successfully. Sep 10 15:21:24 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:21:24 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:21:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Flow 'volume_create_manager' (ee321bfd-c3c0-46df-aab3-967b059e1548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:21:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dbf96b1-71d5-437e-b061-603a21d60793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:21:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dbf96b1-71d5-437e-b061-603a21d60793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-970656777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2af551-a248-47d5-aedf-1982c58c4210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba2ff20d484d494793facc1dd45a6b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:21:25Z,use_quota=True,user_id='cbfc2f5d83554158b6853c220de433e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:21:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786e6900-5c86-45ed-a264-5e24fb9c4f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:21:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (786e6900-5c86-45ed-a264-5e24fb9c4f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:21:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78844b13-3655-41fa-a1ae-1483d04a1b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:21:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78844b13-3655-41fa-a1ae-1483d04a1b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c2af551-a248-47d5-aedf-1982c58c4210', 'volume_name': 'volume-8c2af551-a248-47d5-aedf-1982c58c4210', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:21:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5da3495-2fac-4644-bcee-d8f23786b84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:21:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5da3495-2fac-4644-bcee-d8f23786b84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:21:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21029009-e8d0-44c8-a89f-50916fcd4391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:21:25 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Volume 8c2af551-a248-47d5-aedf-1982c58c4210: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c2af551-a248-47d5-aedf-1982c58c4210', 'volume_size': 1} Sep 10 15:21:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:21:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:21:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-970656777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2af551-a248-47d5-aedf-1982c58c4210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba2ff20d484d494793facc1dd45a6b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:21:25Z,use_quota=True,user_id='cbfc2f5d83554158b6853c220de433e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:21:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Creating volume 8c2af551-a248-47d5-aedf-1982c58c4210 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:21:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:21:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:21:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:21:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:21:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:21:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:21:25 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:21:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c2af551-a248-47d5-aedf-1982c58c4210 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:21:25 devstack quobyte-client[82814]: System call of process 86209 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:21:25 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=10, name=volume-8c2af551-a248-47d5-aedf-1982c58c4210, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:21:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c2af551-a248-47d5-aedf-1982c58c4210 1073741824" returned: 0 in 0.519s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:21:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c2af551-a248-47d5-aedf-1982c58c4210 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:21:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c2af551-a248-47d5-aedf-1982c58c4210" returned: 0 in 0.161s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:21:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] <== create_volume: return (786ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:21:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:21:26 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21029009-e8d0-44c8-a89f-50916fcd4391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c2af551-a248-47d5-aedf-1982c58c4210', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:21:26 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10dbdb72-3430-4a82-977e-277ffe947e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:21:26 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Volume volume-8c2af551-a248-47d5-aedf-1982c58c4210 (8c2af551-a248-47d5-aedf-1982c58c4210): created successfully Sep 10 15:21:26 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10dbdb72-3430-4a82-977e-277ffe947e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:21:26 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Flow 'volume_create_manager' (ee321bfd-c3c0-46df-aab3-967b059e1548) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:21:26 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-560199ea-c57f-4ddc-bc59-a975fff54d99 tempest-AttachVolumeTestJSON-1441596863 None] Created volume successfully. Sep 10 15:21:28 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:21:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:21:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:21:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:21:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:21:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:21:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:21:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.129s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:21:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:21:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-59c0d002-5eb1-41c6-ac1f-65d1dc4a9c19 req-5866b3a2-fe44-432b-8f07-e6fdad1d0cfd tempest-AttachVolumeTestJSON-1441596863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:21:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-59c0d002-5eb1-41c6-ac1f-65d1dc4a9c19 req-5866b3a2-fe44-432b-8f07-e6fdad1d0cfd tempest-AttachVolumeTestJSON-1441596863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:21:31 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[815ca935-2155-47a4-9d3c-2e0627e92e6e]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:21:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-59c0d002-5eb1-41c6-ac1f-65d1dc4a9c19 req-5866b3a2-fe44-432b-8f07-e6fdad1d0cfd tempest-AttachVolumeTestJSON-1441596863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c2af551-a248-47d5-aedf-1982c58c4210 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:21:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-59c0d002-5eb1-41c6-ac1f-65d1dc4a9c19 req-5866b3a2-fe44-432b-8f07-e6fdad1d0cfd tempest-AttachVolumeTestJSON-1441596863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c2af551-a248-47d5-aedf-1982c58c4210" returned: 0 in 0.667s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:21:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-59c0d002-5eb1-41c6-ac1f-65d1dc4a9c19 req-5866b3a2-fe44-432b-8f07-e6fdad1d0cfd tempest-AttachVolumeTestJSON-1441596863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.738s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:21:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-59c0d002-5eb1-41c6-ac1f-65d1dc4a9c19 req-5866b3a2-fe44-432b-8f07-e6fdad1d0cfd tempest-AttachVolumeTestJSON-1441596863 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5', 'name': 'volume-8c2af551-a248-47d5-aedf-1982c58c4210', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '48b43761-2745-4be1-a73b-742cb5c792ce', 'enforce_multipath': True} {{(pid=82800) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 15:21:32 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-59c0d002-5eb1-41c6-ac1f-65d1dc4a9c19 req-5866b3a2-fe44-432b-8f07-e6fdad1d0cfd tempest-AttachVolumeTestJSON-1441596863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:21:32 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-59c0d002-5eb1-41c6-ac1f-65d1dc4a9c19 req-5866b3a2-fe44-432b-8f07-e6fdad1d0cfd tempest-AttachVolumeTestJSON-1441596863 None] attachment_update completed successfully. Sep 10 15:21:42 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=21,cinder:UPDATE=7,cinder:INSERT=12,cinder:DELETE=2 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:21:42 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=14,cinder:UPDATE=16,cinder:INSERT=1,cinder:DELETE=2 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:21:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-c6082f45-2764-4aa3-9c22-7071df36999a req-28aa84c8-cea6-49aa-8113-0b30aee5bc21 tempest-TaggedBootDevicesTest-1872382209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:21:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-c6082f45-2764-4aa3-9c22-7071df36999a req-28aa84c8-cea6-49aa-8113-0b30aee5bc21 tempest-TaggedBootDevicesTest-1872382209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:21:56 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[6338494e-8188-455c-9f2e-61d91c689298]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:21:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-c6082f45-2764-4aa3-9c22-7071df36999a req-28aa84c8-cea6-49aa-8113-0b30aee5bc21 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:21:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-c6082f45-2764-4aa3-9c22-7071df36999a req-28aa84c8-cea6-49aa-8113-0b30aee5bc21 tempest-TaggedBootDevicesTest-1872382209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9" returned: 0 in 0.947s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:21:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-c6082f45-2764-4aa3-9c22-7071df36999a req-28aa84c8-cea6-49aa-8113-0b30aee5bc21 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:21:58 devstack quobyte-client[82814]: System call of process 86867 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:21:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-c6082f45-2764-4aa3-9c22-7071df36999a req-28aa84c8-cea6-49aa-8113-0b30aee5bc21 tempest-TaggedBootDevicesTest-1872382209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9" returned: 1 in 0.976s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:21:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-c6082f45-2764-4aa3-9c22-7071df36999a req-28aa84c8-cea6-49aa-8113-0b30aee5bc21 tempest-TaggedBootDevicesTest-1872382209 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:21:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-c6082f45-2764-4aa3-9c22-7071df36999a req-28aa84c8-cea6-49aa-8113-0b30aee5bc21 tempest-TaggedBootDevicesTest-1872382209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.403s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:21:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-c6082f45-2764-4aa3-9c22-7071df36999a req-28aa84c8-cea6-49aa-8113-0b30aee5bc21 tempest-TaggedBootDevicesTest-1872382209 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5', 'name': 'volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '00c16999-4a87-4b71-aef6-74d0a5ab4b7f', 'enforce_multipath': True} {{(pid=82800) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 15:21:59 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-c6082f45-2764-4aa3-9c22-7071df36999a req-28aa84c8-cea6-49aa-8113-0b30aee5bc21 tempest-TaggedBootDevicesTest-1872382209 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:22:00 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-c6082f45-2764-4aa3-9c22-7071df36999a req-28aa84c8-cea6-49aa-8113-0b30aee5bc21 tempest-TaggedBootDevicesTest-1872382209 None] attachment_update completed successfully. Sep 10 15:22:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-c6082f45-2764-4aa3-9c22-7071df36999a req-51835506-74a9-4667-8f3f-c41649517f86 tempest-TaggedBootDevicesTest-1872382209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:22:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-c6082f45-2764-4aa3-9c22-7071df36999a req-51835506-74a9-4667-8f3f-c41649517f86 tempest-TaggedBootDevicesTest-1872382209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.012s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:22:09 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf0c889-b0f1-482c-afe8-0709626301e0]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:22:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-c6082f45-2764-4aa3-9c22-7071df36999a req-51835506-74a9-4667-8f3f-c41649517f86 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4133ab57-e001-41d7-a964-78e4d1b3b5aa {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:22:10 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:22:10 devstack quobyte-client[82814]: System call of process 86949 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:22:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-c6082f45-2764-4aa3-9c22-7071df36999a req-51835506-74a9-4667-8f3f-c41649517f86 tempest-TaggedBootDevicesTest-1872382209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4133ab57-e001-41d7-a964-78e4d1b3b5aa" returned: 0 in 1.730s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:22:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-c6082f45-2764-4aa3-9c22-7071df36999a req-51835506-74a9-4667-8f3f-c41649517f86 tempest-TaggedBootDevicesTest-1872382209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.872s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:22:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-c6082f45-2764-4aa3-9c22-7071df36999a req-51835506-74a9-4667-8f3f-c41649517f86 tempest-TaggedBootDevicesTest-1872382209 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5', 'name': 'volume-4133ab57-e001-41d7-a964-78e4d1b3b5aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ff82d99d-912e-428b-a19e-022d1fc67c39', 'enforce_multipath': True} {{(pid=82800) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 15:22:11 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-c6082f45-2764-4aa3-9c22-7071df36999a req-51835506-74a9-4667-8f3f-c41649517f86 tempest-TaggedBootDevicesTest-1872382209 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:22:12 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-c6082f45-2764-4aa3-9c22-7071df36999a req-51835506-74a9-4667-8f3f-c41649517f86 tempest-TaggedBootDevicesTest-1872382209 None] attachment_update completed successfully. Sep 10 15:22:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-c6082f45-2764-4aa3-9c22-7071df36999a req-76134082-3d07-4e2c-a45b-b73be9473025 tempest-TaggedBootDevicesTest-1872382209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:22:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-c6082f45-2764-4aa3-9c22-7071df36999a req-76134082-3d07-4e2c-a45b-b73be9473025 tempest-TaggedBootDevicesTest-1872382209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.012s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:22:19 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[7998055a-8926-4491-96d5-8486e4a0dd37]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:22:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-c6082f45-2764-4aa3-9c22-7071df36999a req-76134082-3d07-4e2c-a45b-b73be9473025 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-722b1a12-ba78-4e42-9d75-ec54e4cc93be {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:22:21 devstack quobyte-client[82814]: System call of process 87353 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:22:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-c6082f45-2764-4aa3-9c22-7071df36999a req-76134082-3d07-4e2c-a45b-b73be9473025 tempest-TaggedBootDevicesTest-1872382209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-722b1a12-ba78-4e42-9d75-ec54e4cc93be" returned: 0 in 1.817s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:22:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-c6082f45-2764-4aa3-9c22-7071df36999a req-76134082-3d07-4e2c-a45b-b73be9473025 tempest-TaggedBootDevicesTest-1872382209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.018s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:22:22 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-c6082f45-2764-4aa3-9c22-7071df36999a req-76134082-3d07-4e2c-a45b-b73be9473025 tempest-TaggedBootDevicesTest-1872382209 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5', 'name': 'volume-722b1a12-ba78-4e42-9d75-ec54e4cc93be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da62eb65-8987-4120-ba9b-c01885856ade', 'enforce_multipath': True} {{(pid=82800) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 15:22:22 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-c6082f45-2764-4aa3-9c22-7071df36999a req-76134082-3d07-4e2c-a45b-b73be9473025 tempest-TaggedBootDevicesTest-1872382209 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:22:22 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-c6082f45-2764-4aa3-9c22-7071df36999a req-76134082-3d07-4e2c-a45b-b73be9473025 tempest-TaggedBootDevicesTest-1872382209 None] attachment_update completed successfully. Sep 10 15:22:28 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:22:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:22:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.027s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:22:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:22:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:22:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.084s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:22:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:22:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.399s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:22:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:22:32 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:22:32 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=16,cinder:UPDATE=4 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:23:08 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:23:19 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:23:20 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:23:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Flow 'volume_create_manager' (d9027be2-04f5-44a7-b1d6-80ffe11cd9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:23:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72a46ae-3bf9-4fca-bf4c-e943dffa57d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:23:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72a46ae-3bf9-4fca-bf4c-e943dffa57d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-613814573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86dcba84-d86a-4366-8ca5-8b190dabfd13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f230d5fc6de3464d9bada4e16bef2d12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:23:19Z,use_quota=True,user_id='6bf3f8597a6449d09d77f9ee97d8dc22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:23:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf32071-2257-4cfd-b6dd-7ab8154114bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:23:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf32071-2257-4cfd-b6dd-7ab8154114bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:23:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b457b0-80f5-4b86-8b63-5d13a6c18078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:23:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b457b0-80f5-4b86-8b63-5d13a6c18078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86dcba84-d86a-4366-8ca5-8b190dabfd13', 'volume_name': 'volume-86dcba84-d86a-4366-8ca5-8b190dabfd13', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:23:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c5cbea-2464-44bb-a791-527d9f583fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:23:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c5cbea-2464-44bb-a791-527d9f583fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:23:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d3823e2-60b0-433c-a35c-8599694cc89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:23:20 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Volume 86dcba84-d86a-4366-8ca5-8b190dabfd13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86dcba84-d86a-4366-8ca5-8b190dabfd13', 'volume_size': 1} Sep 10 15:23:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:23:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:23:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-613814573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86dcba84-d86a-4366-8ca5-8b190dabfd13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f230d5fc6de3464d9bada4e16bef2d12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:23:19Z,use_quota=True,user_id='6bf3f8597a6449d09d77f9ee97d8dc22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:23:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Creating volume 86dcba84-d86a-4366-8ca5-8b190dabfd13 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:23:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:23:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:23:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:23:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:23:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.056s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:23:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:23:20 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:23:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86dcba84-d86a-4366-8ca5-8b190dabfd13 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:23:21 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=11, name=volume-86dcba84-d86a-4366-8ca5-8b190dabfd13, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:23:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86dcba84-d86a-4366-8ca5-8b190dabfd13 1073741824" returned: 0 in 1.554s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:23:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86dcba84-d86a-4366-8ca5-8b190dabfd13 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:23:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86dcba84-d86a-4366-8ca5-8b190dabfd13" returned: 0 in 0.319s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:23:23 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] <== create_volume: return (2239ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:23:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.315s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:23:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d3823e2-60b0-433c-a35c-8599694cc89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86dcba84-d86a-4366-8ca5-8b190dabfd13', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:23:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de0187be-912d-495b-b85d-a89017ee340e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:23:24 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Volume volume-86dcba84-d86a-4366-8ca5-8b190dabfd13 (86dcba84-d86a-4366-8ca5-8b190dabfd13): created successfully Sep 10 15:23:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de0187be-912d-495b-b85d-a89017ee340e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:23:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Flow 'volume_create_manager' (d9027be2-04f5-44a7-b1d6-80ffe11cd9c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:23:24 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-b3223966-ebbc-4458-82fb-411ca933628f tempest-AttachVolumeShelveTestJSON-83004131 None] Created volume successfully. Sep 10 15:23:28 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:23:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:23:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:23:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:23:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:23:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:23:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:23:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.391s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:23:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:23:34 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:23:34 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:24:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-09b566fe-5454-46f9-9e0f-eed49d2fb98d req-0d7ba8e1-e6c4-42be-84ee-bf660161212c tempest-AttachVolumeShelveTestJSON-83004131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:24:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-09b566fe-5454-46f9-9e0f-eed49d2fb98d req-0d7ba8e1-e6c4-42be-84ee-bf660161212c tempest-AttachVolumeShelveTestJSON-83004131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:24:04 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e90c70-293a-4d59-8b11-5f33e878f5f9]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:24:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-09b566fe-5454-46f9-9e0f-eed49d2fb98d req-0d7ba8e1-e6c4-42be-84ee-bf660161212c tempest-AttachVolumeShelveTestJSON-83004131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86dcba84-d86a-4366-8ca5-8b190dabfd13 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:24:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-09b566fe-5454-46f9-9e0f-eed49d2fb98d req-0d7ba8e1-e6c4-42be-84ee-bf660161212c tempest-AttachVolumeShelveTestJSON-83004131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86dcba84-d86a-4366-8ca5-8b190dabfd13" returned: 0 in 0.574s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:24:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-09b566fe-5454-46f9-9e0f-eed49d2fb98d req-0d7ba8e1-e6c4-42be-84ee-bf660161212c tempest-AttachVolumeShelveTestJSON-83004131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.664s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:24:05 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-09b566fe-5454-46f9-9e0f-eed49d2fb98d req-0d7ba8e1-e6c4-42be-84ee-bf660161212c tempest-AttachVolumeShelveTestJSON-83004131 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5', 'name': 'volume-86dcba84-d86a-4366-8ca5-8b190dabfd13', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fbffa29e-5e3f-413a-808a-416786385c02', 'enforce_multipath': True} {{(pid=82800) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 15:24:05 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-09b566fe-5454-46f9-9e0f-eed49d2fb98d req-0d7ba8e1-e6c4-42be-84ee-bf660161212c tempest-AttachVolumeShelveTestJSON-83004131 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:24:05 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-09b566fe-5454-46f9-9e0f-eed49d2fb98d req-0d7ba8e1-e6c4-42be-84ee-bf660161212c tempest-AttachVolumeShelveTestJSON-83004131 None] attachment_update completed successfully. Sep 10 15:24:12 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-4db6cf55-ef67-44b2-bf8c-68d67a89eac6 req-3cc9203c-3e41-408a-aa00-3b911af1974f tempest-AttachVolumeTestJSON-1441596863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:24:12 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-4db6cf55-ef67-44b2-bf8c-68d67a89eac6 req-3cc9203c-3e41-408a-aa00-3b911af1974f tempest-AttachVolumeTestJSON-1441596863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:24:12 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-4db6cf55-ef67-44b2-bf8c-68d67a89eac6 req-3cc9203c-3e41-408a-aa00-3b911af1974f tempest-AttachVolumeTestJSON-1441596863 None] Terminate volume connection completed successfully. Sep 10 15:24:12 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-4db6cf55-ef67-44b2-bf8c-68d67a89eac6 req-3cc9203c-3e41-408a-aa00-3b911af1974f tempest-AttachVolumeTestJSON-1441596863 None] Deleting attachment 48b43761-2745-4be1-a73b-742cb5c792ce. {{(pid=82800) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 15:24:15 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:24:22 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:24:28 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:24:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:24:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:24:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:24:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:24:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:24:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:24:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.168s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:24:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:25:08 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:25:28 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:25:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:25:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:25:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:25:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:25:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.124s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:25:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:25:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.794s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:25:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:25:47 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-1152d0bb-31b2-40a2-82f7-69a9016e6994 req-b5ae3a50-ec06-4445-bf90-fe3174e70321 tempest-TaggedBootDevicesTest-1872382209 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:25:47 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-1152d0bb-31b2-40a2-82f7-69a9016e6994 req-b5ae3a50-ec06-4445-bf90-fe3174e70321 tempest-TaggedBootDevicesTest-1872382209 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:25:47 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-1152d0bb-31b2-40a2-82f7-69a9016e6994 req-b5ae3a50-ec06-4445-bf90-fe3174e70321 tempest-TaggedBootDevicesTest-1872382209 None] Terminate volume connection completed successfully. Sep 10 15:25:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-1152d0bb-31b2-40a2-82f7-69a9016e6994 req-b5ae3a50-ec06-4445-bf90-fe3174e70321 tempest-TaggedBootDevicesTest-1872382209 None] Deleting attachment 00c16999-4a87-4b71-aef6-74d0a5ab4b7f. {{(pid=82800) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 15:25:48 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-1152d0bb-31b2-40a2-82f7-69a9016e6994 req-30e3a483-9d0e-4c8c-97e1-e2c322c2d7c7 tempest-TaggedBootDevicesTest-1872382209 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:25:48 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-1152d0bb-31b2-40a2-82f7-69a9016e6994 req-30e3a483-9d0e-4c8c-97e1-e2c322c2d7c7 tempest-TaggedBootDevicesTest-1872382209 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:25:48 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-1152d0bb-31b2-40a2-82f7-69a9016e6994 req-30e3a483-9d0e-4c8c-97e1-e2c322c2d7c7 tempest-TaggedBootDevicesTest-1872382209 None] Terminate volume connection completed successfully. Sep 10 15:25:48 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-1152d0bb-31b2-40a2-82f7-69a9016e6994 req-30e3a483-9d0e-4c8c-97e1-e2c322c2d7c7 tempest-TaggedBootDevicesTest-1872382209 None] Deleting attachment ff82d99d-912e-428b-a19e-022d1fc67c39. {{(pid=82800) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 15:25:48 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-1152d0bb-31b2-40a2-82f7-69a9016e6994 req-c1fe171c-0e23-4e1d-be38-d192580fdbde tempest-TaggedBootDevicesTest-1872382209 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:25:48 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-1152d0bb-31b2-40a2-82f7-69a9016e6994 req-c1fe171c-0e23-4e1d-be38-d192580fdbde tempest-TaggedBootDevicesTest-1872382209 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:25:48 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-1152d0bb-31b2-40a2-82f7-69a9016e6994 req-c1fe171c-0e23-4e1d-be38-d192580fdbde tempest-TaggedBootDevicesTest-1872382209 None] Terminate volume connection completed successfully. Sep 10 15:25:48 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-1152d0bb-31b2-40a2-82f7-69a9016e6994 req-c1fe171c-0e23-4e1d-be38-d192580fdbde tempest-TaggedBootDevicesTest-1872382209 None] Deleting attachment da62eb65-8987-4120-ba9b-c01885856ade. {{(pid=82800) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 15:25:58 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=3 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:25:58 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=3 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:25:59 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-70438aef-4016-4241-b00e-e79a605e5f88 tempest-TaggedBootDevicesTest-1872382209 None] Acquiring lock "cinder-722b1a12-ba78-4e42-9d75-ec54e4cc93be-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:25:59 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-70438aef-4016-4241-b00e-e79a605e5f88 tempest-TaggedBootDevicesTest-1872382209 None] Lock "cinder-722b1a12-ba78-4e42-9d75-ec54e4cc93be-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:25:59 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-70438aef-4016-4241-b00e-e79a605e5f88 tempest-TaggedBootDevicesTest-1872382209 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:25:59 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-70438aef-4016-4241-b00e-e79a605e5f88 tempest-TaggedBootDevicesTest-1872382209 None] Acquiring lock "cinder-quobyte-722b1a12-ba78-4e42-9d75-ec54e4cc93be" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:25:59 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-70438aef-4016-4241-b00e-e79a605e5f88 tempest-TaggedBootDevicesTest-1872382209 None] Lock "cinder-quobyte-722b1a12-ba78-4e42-9d75-ec54e4cc93be" acquired by "delete_volume" :: waited 0.026s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:25:59 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14fbdb6-4ead-430d-9295-dfebb92979ea]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:25:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-70438aef-4016-4241-b00e-e79a605e5f88 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-722b1a12-ba78-4e42-9d75-ec54e4cc93be {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:26:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-70438aef-4016-4241-b00e-e79a605e5f88 tempest-TaggedBootDevicesTest-1872382209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-722b1a12-ba78-4e42-9d75-ec54e4cc93be" returned: 0 in 0.628s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:26:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-70438aef-4016-4241-b00e-e79a605e5f88 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-722b1a12-ba78-4e42-9d75-ec54e4cc93be {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:26:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-70438aef-4016-4241-b00e-e79a605e5f88 tempest-TaggedBootDevicesTest-1872382209 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-722b1a12-ba78-4e42-9d75-ec54e4cc93be" returned: 0 in 0.142s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:26:00 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-70438aef-4016-4241-b00e-e79a605e5f88 tempest-TaggedBootDevicesTest-1872382209 None] Lock "cinder-quobyte-722b1a12-ba78-4e42-9d75-ec54e4cc93be" released by "delete_volume" :: held 0.977s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:26:00 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-70438aef-4016-4241-b00e-e79a605e5f88 tempest-TaggedBootDevicesTest-1872382209 None] Created reservations ['e8201996-4a94-420f-9297-d0c4741bc072', 'a1f9a51e-5a00-4114-9430-616ea7229329', '1ef22527-4311-4856-911c-3ac80c0f2aab', 'd1930daf-6520-4693-85d3-192199a5d5e3'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:26:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-70438aef-4016-4241-b00e-e79a605e5f88 tempest-TaggedBootDevicesTest-1872382209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:26:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-70438aef-4016-4241-b00e-e79a605e5f88 tempest-TaggedBootDevicesTest-1872382209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:26:00 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-70438aef-4016-4241-b00e-e79a605e5f88 tempest-TaggedBootDevicesTest-1872382209 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:26:00 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-70438aef-4016-4241-b00e-e79a605e5f88 tempest-TaggedBootDevicesTest-1872382209 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:26:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-70438aef-4016-4241-b00e-e79a605e5f88 tempest-TaggedBootDevicesTest-1872382209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:26:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-70438aef-4016-4241-b00e-e79a605e5f88 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:26:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-70438aef-4016-4241-b00e-e79a605e5f88 tempest-TaggedBootDevicesTest-1872382209 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.137s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:26:01 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-70438aef-4016-4241-b00e-e79a605e5f88 tempest-TaggedBootDevicesTest-1872382209 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:26:01 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-70438aef-4016-4241-b00e-e79a605e5f88 tempest-TaggedBootDevicesTest-1872382209 None] Deleted volume successfully. Sep 10 15:26:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-70438aef-4016-4241-b00e-e79a605e5f88 tempest-TaggedBootDevicesTest-1872382209 None] Lock "cinder-722b1a12-ba78-4e42-9d75-ec54e4cc93be-delete_volume" released by "delete_volume" :: held 2.138s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:26:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-5b0af150-b6ee-4b94-b1d5-d0a4c6098ea4 tempest-TaggedBootDevicesTest-1872382209 None] Acquiring lock "cinder-4133ab57-e001-41d7-a964-78e4d1b3b5aa-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:26:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-5b0af150-b6ee-4b94-b1d5-d0a4c6098ea4 tempest-TaggedBootDevicesTest-1872382209 None] Lock "cinder-4133ab57-e001-41d7-a964-78e4d1b3b5aa-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:26:02 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-5b0af150-b6ee-4b94-b1d5-d0a4c6098ea4 tempest-TaggedBootDevicesTest-1872382209 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:26:02 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-5b0af150-b6ee-4b94-b1d5-d0a4c6098ea4 tempest-TaggedBootDevicesTest-1872382209 None] Acquiring lock "cinder-quobyte-4133ab57-e001-41d7-a964-78e4d1b3b5aa" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:26:02 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-5b0af150-b6ee-4b94-b1d5-d0a4c6098ea4 tempest-TaggedBootDevicesTest-1872382209 None] Lock "cinder-quobyte-4133ab57-e001-41d7-a964-78e4d1b3b5aa" acquired by "delete_volume" :: waited 0.028s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:26:02 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78abe98-3ed1-4a0c-ae0e-a3e933be4fff]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:26:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b0af150-b6ee-4b94-b1d5-d0a4c6098ea4 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4133ab57-e001-41d7-a964-78e4d1b3b5aa {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:26:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b0af150-b6ee-4b94-b1d5-d0a4c6098ea4 tempest-TaggedBootDevicesTest-1872382209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4133ab57-e001-41d7-a964-78e4d1b3b5aa" returned: 0 in 1.598s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:26:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b0af150-b6ee-4b94-b1d5-d0a4c6098ea4 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4133ab57-e001-41d7-a964-78e4d1b3b5aa {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:26:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b0af150-b6ee-4b94-b1d5-d0a4c6098ea4 tempest-TaggedBootDevicesTest-1872382209 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4133ab57-e001-41d7-a964-78e4d1b3b5aa" returned: 0 in 0.584s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:26:04 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-5b0af150-b6ee-4b94-b1d5-d0a4c6098ea4 tempest-TaggedBootDevicesTest-1872382209 None] Lock "cinder-quobyte-4133ab57-e001-41d7-a964-78e4d1b3b5aa" released by "delete_volume" :: held 2.561s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:26:05 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-5b0af150-b6ee-4b94-b1d5-d0a4c6098ea4 tempest-TaggedBootDevicesTest-1872382209 None] Created reservations ['fb6be9f4-1f0a-4327-bb61-48b7fd2e8fd6', '74237112-a872-4787-989b-59fb2b590de2', '811a16fc-5f80-478a-a743-42ba30f037f3', '722519e7-3e23-4f59-8f26-dc48eee40a0b'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:26:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-5b0af150-b6ee-4b94-b1d5-d0a4c6098ea4 tempest-TaggedBootDevicesTest-1872382209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:26:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-5b0af150-b6ee-4b94-b1d5-d0a4c6098ea4 tempest-TaggedBootDevicesTest-1872382209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:26:05 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-5b0af150-b6ee-4b94-b1d5-d0a4c6098ea4 tempest-TaggedBootDevicesTest-1872382209 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:26:05 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-5b0af150-b6ee-4b94-b1d5-d0a4c6098ea4 tempest-TaggedBootDevicesTest-1872382209 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:26:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-5b0af150-b6ee-4b94-b1d5-d0a4c6098ea4 tempest-TaggedBootDevicesTest-1872382209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:26:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b0af150-b6ee-4b94-b1d5-d0a4c6098ea4 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:26:06 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-83f56ee4-3809-4bbb-bb36-e9320b906e07 tempest-TaggedBootDevicesTest-1872382209 None] Acquiring lock "cinder-03d98163-b710-4748-a0a2-eaac6dd3c2c9-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:26:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b0af150-b6ee-4b94-b1d5-d0a4c6098ea4 tempest-TaggedBootDevicesTest-1872382209 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.607s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:26:06 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-5b0af150-b6ee-4b94-b1d5-d0a4c6098ea4 tempest-TaggedBootDevicesTest-1872382209 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:26:06 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-5b0af150-b6ee-4b94-b1d5-d0a4c6098ea4 tempest-TaggedBootDevicesTest-1872382209 None] Deleted volume successfully. Sep 10 15:26:06 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-83f56ee4-3809-4bbb-bb36-e9320b906e07 tempest-TaggedBootDevicesTest-1872382209 None] Lock "cinder-03d98163-b710-4748-a0a2-eaac6dd3c2c9-delete_volume" acquired by "delete_volume" :: waited 0.297s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:26:06 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-5b0af150-b6ee-4b94-b1d5-d0a4c6098ea4 tempest-TaggedBootDevicesTest-1872382209 None] Lock "cinder-4133ab57-e001-41d7-a964-78e4d1b3b5aa-delete_volume" released by "delete_volume" :: held 4.741s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:26:06 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-83f56ee4-3809-4bbb-bb36-e9320b906e07 tempest-TaggedBootDevicesTest-1872382209 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:26:06 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-83f56ee4-3809-4bbb-bb36-e9320b906e07 tempest-TaggedBootDevicesTest-1872382209 None] Acquiring lock "cinder-quobyte-03d98163-b710-4748-a0a2-eaac6dd3c2c9" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:26:06 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-83f56ee4-3809-4bbb-bb36-e9320b906e07 tempest-TaggedBootDevicesTest-1872382209 None] Lock "cinder-quobyte-03d98163-b710-4748-a0a2-eaac6dd3c2c9" acquired by "delete_volume" :: waited 0.051s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:26:06 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d91597-5bca-4ac3-ac2c-fc7648229760]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:26:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-83f56ee4-3809-4bbb-bb36-e9320b906e07 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:26:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-83f56ee4-3809-4bbb-bb36-e9320b906e07 tempest-TaggedBootDevicesTest-1872382209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9" returned: 0 in 1.305s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:26:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-83f56ee4-3809-4bbb-bb36-e9320b906e07 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:26:09 devstack quobyte-client[82814]: System call of process 89271 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:26:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-83f56ee4-3809-4bbb-bb36-e9320b906e07 tempest-TaggedBootDevicesTest-1872382209 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9" returned: 1 in 1.348s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:26:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-83f56ee4-3809-4bbb-bb36-e9320b906e07 tempest-TaggedBootDevicesTest-1872382209 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:26:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-83f56ee4-3809-4bbb-bb36-e9320b906e07 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:26:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-83f56ee4-3809-4bbb-bb36-e9320b906e07 tempest-TaggedBootDevicesTest-1872382209 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-03d98163-b710-4748-a0a2-eaac6dd3c2c9" returned: 0 in 0.199s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:26:10 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-83f56ee4-3809-4bbb-bb36-e9320b906e07 tempest-TaggedBootDevicesTest-1872382209 None] Lock "cinder-quobyte-03d98163-b710-4748-a0a2-eaac6dd3c2c9" released by "delete_volume" :: held 3.428s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:26:12 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-83f56ee4-3809-4bbb-bb36-e9320b906e07 tempest-TaggedBootDevicesTest-1872382209 None] Created reservations ['8b288b14-03e7-44e0-9ad2-421d3531c35b', 'ac41cf15-b558-407a-9545-b13334853d2d', 'c03c46c5-e39c-4592-90ea-84982e164aa3', '57f4d53f-196f-4281-a8eb-97720c282399'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:26:13 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-83f56ee4-3809-4bbb-bb36-e9320b906e07 tempest-TaggedBootDevicesTest-1872382209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:26:13 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-83f56ee4-3809-4bbb-bb36-e9320b906e07 tempest-TaggedBootDevicesTest-1872382209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:26:13 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-83f56ee4-3809-4bbb-bb36-e9320b906e07 tempest-TaggedBootDevicesTest-1872382209 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:26:13 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-83f56ee4-3809-4bbb-bb36-e9320b906e07 tempest-TaggedBootDevicesTest-1872382209 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:26:13 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-83f56ee4-3809-4bbb-bb36-e9320b906e07 tempest-TaggedBootDevicesTest-1872382209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:26:13 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-83f56ee4-3809-4bbb-bb36-e9320b906e07 tempest-TaggedBootDevicesTest-1872382209 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:26:13 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-83f56ee4-3809-4bbb-bb36-e9320b906e07 tempest-TaggedBootDevicesTest-1872382209 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.337s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:26:13 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-83f56ee4-3809-4bbb-bb36-e9320b906e07 tempest-TaggedBootDevicesTest-1872382209 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:26:13 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-83f56ee4-3809-4bbb-bb36-e9320b906e07 tempest-TaggedBootDevicesTest-1872382209 None] Deleted volume successfully. Sep 10 15:26:14 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-83f56ee4-3809-4bbb-bb36-e9320b906e07 tempest-TaggedBootDevicesTest-1872382209 None] Lock "cinder-03d98163-b710-4748-a0a2-eaac6dd3c2c9-delete_volume" released by "delete_volume" :: held 8.160s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:26:23 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=21,cinder:SELECT=12,cinder:INSERT=8,cinder:DELETE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:26:24 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=18,cinder:UPDATE=27,cinder:DELETE=2,cinder:INSERT=4 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:26:28 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:26:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:26:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:26:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:26:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:26:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:26:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:26:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.244s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:26:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:26:37 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-70012b17-b67a-4092-8ff7-ca642d4da929 req-c11818b6-f0b9-4015-b924-c23ff110abf5 tempest-AttachVolumeShelveTestJSON-83004131 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:26:37 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-70012b17-b67a-4092-8ff7-ca642d4da929 req-c11818b6-f0b9-4015-b924-c23ff110abf5 tempest-AttachVolumeShelveTestJSON-83004131 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:26:37 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-70012b17-b67a-4092-8ff7-ca642d4da929 req-c11818b6-f0b9-4015-b924-c23ff110abf5 tempest-AttachVolumeShelveTestJSON-83004131 None] Terminate volume connection completed successfully. Sep 10 15:26:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-70012b17-b67a-4092-8ff7-ca642d4da929 req-c11818b6-f0b9-4015-b924-c23ff110abf5 tempest-AttachVolumeShelveTestJSON-83004131 None] Deleting attachment fbffa29e-5e3f-413a-808a-416786385c02. {{(pid=82800) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 15:26:47 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:26:47 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:27:07 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:27:07 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:27:28 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:27:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:27:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:27:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:27:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:27:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:27:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:27:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.151s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:27:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:28:21 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:28:21 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:28:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Flow 'volume_create_manager' (a74314c3-5ab5-4c35-a1de-7c404b67b16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:28:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233481e5-efcc-4f18-a4a7-648224c7e457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:28:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233481e5-efcc-4f18-a4a7-648224c7e457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1557897172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f5dd56-28db-4ac9-a860-c7ed52132b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba2ff20d484d494793facc1dd45a6b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:28:21Z,use_quota=True,user_id='cbfc2f5d83554158b6853c220de433e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:28:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e929588-fe1e-414d-8a2e-c69728b5e3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:28:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e929588-fe1e-414d-8a2e-c69728b5e3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:28:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a61c050-ea61-4777-ac51-d58d78d27e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:28:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a61c050-ea61-4777-ac51-d58d78d27e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43f5dd56-28db-4ac9-a860-c7ed52132b68', 'volume_name': 'volume-43f5dd56-28db-4ac9-a860-c7ed52132b68', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:28:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be468e7-3c98-4464-a2a1-7d95ed1bf0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:28:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be468e7-3c98-4464-a2a1-7d95ed1bf0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:28:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19fec8bd-91c8-4fdb-8cb9-5fd8b48d6fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:28:21 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Volume 43f5dd56-28db-4ac9-a860-c7ed52132b68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43f5dd56-28db-4ac9-a860-c7ed52132b68', 'volume_size': 1} Sep 10 15:28:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:28:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:28:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:28:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1557897172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f5dd56-28db-4ac9-a860-c7ed52132b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba2ff20d484d494793facc1dd45a6b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:28:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:28:21Z,use_quota=True,user_id='cbfc2f5d83554158b6853c220de433e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:28:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Creating volume 43f5dd56-28db-4ac9-a860-c7ed52132b68 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:28:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:28:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:28:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:28:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:28:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:28:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:28:21 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:28:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-43f5dd56-28db-4ac9-a860-c7ed52132b68 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:28:22 devstack quobyte-client[82814]: System call of process 89906 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:28:22 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=12, name=volume-43f5dd56-28db-4ac9-a860-c7ed52132b68, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:28:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-43f5dd56-28db-4ac9-a860-c7ed52132b68 1073741824" returned: 0 in 0.670s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:28:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-43f5dd56-28db-4ac9-a860-c7ed52132b68 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:28:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-43f5dd56-28db-4ac9-a860-c7ed52132b68" returned: 0 in 0.197s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:28:23 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] <== create_volume: return (1114ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:28:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:28:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19fec8bd-91c8-4fdb-8cb9-5fd8b48d6fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43f5dd56-28db-4ac9-a860-c7ed52132b68', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:28:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd7fafd-0326-4650-956d-f5075c816631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:28:23 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Volume volume-43f5dd56-28db-4ac9-a860-c7ed52132b68 (43f5dd56-28db-4ac9-a860-c7ed52132b68): created successfully Sep 10 15:28:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd7fafd-0326-4650-956d-f5075c816631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:28:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Flow 'volume_create_manager' (a74314c3-5ab5-4c35-a1de-7c404b67b16c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:28:23 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-e517fdef-f763-4c9d-99b9-bc4fc94ac5a5 tempest-AttachVolumeTestJSON-1441596863 None] Created volume successfully. Sep 10 15:28:28 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:28:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:28:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:28:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:28:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:28:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:28:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:28:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.324s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:28:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:28:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-49ca2942-3890-4155-b670-1bbc0a2027bd req-9b2631f5-a7cf-4987-896e-b8a4922027cf tempest-AttachVolumeTestJSON-1441596863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:28:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-49ca2942-3890-4155-b670-1bbc0a2027bd req-9b2631f5-a7cf-4987-896e-b8a4922027cf tempest-AttachVolumeTestJSON-1441596863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.022s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:28:31 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[4008a1c5-c1b1-4457-b268-d52f65210047]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:28:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-49ca2942-3890-4155-b670-1bbc0a2027bd req-9b2631f5-a7cf-4987-896e-b8a4922027cf tempest-AttachVolumeTestJSON-1441596863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-43f5dd56-28db-4ac9-a860-c7ed52132b68 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:28:32 devstack quobyte-client[82814]: System call of process 89923 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:28:32 devstack quobyte-client[82814]: System call of process 89923 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:28:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-49ca2942-3890-4155-b670-1bbc0a2027bd req-9b2631f5-a7cf-4987-896e-b8a4922027cf tempest-AttachVolumeTestJSON-1441596863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-43f5dd56-28db-4ac9-a860-c7ed52132b68" returned: 0 in 1.392s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:28:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-49ca2942-3890-4155-b670-1bbc0a2027bd req-9b2631f5-a7cf-4987-896e-b8a4922027cf tempest-AttachVolumeTestJSON-1441596863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.651s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:28:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-49ca2942-3890-4155-b670-1bbc0a2027bd req-9b2631f5-a7cf-4987-896e-b8a4922027cf tempest-AttachVolumeTestJSON-1441596863 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5', 'name': 'volume-43f5dd56-28db-4ac9-a860-c7ed52132b68', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8bd770ae-e479-4447-9bd3-74b2e24e9748', 'enforce_multipath': True} {{(pid=82800) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 15:28:34 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-49ca2942-3890-4155-b670-1bbc0a2027bd req-9b2631f5-a7cf-4987-896e-b8a4922027cf tempest-AttachVolumeTestJSON-1441596863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:28:34 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-49ca2942-3890-4155-b670-1bbc0a2027bd req-9b2631f5-a7cf-4987-896e-b8a4922027cf tempest-AttachVolumeTestJSON-1441596863 None] attachment_update completed successfully. Sep 10 15:28:44 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=4,cinder:DELETE=1,cinder:SELECT=5 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:28:44 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:28:48 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:28:48 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:28:48 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Flow 'volume_create_manager' (596611bd-a958-4d2a-a93d-79a57afd3229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:28:48 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (181e75e7-1b92-408e-8919-5d5c9eb1770e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:28:48 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (181e75e7-1b92-408e-8919-5d5c9eb1770e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1406906461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c77b83d5-cce7-4111-b244-a203d665087d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba2ff20d484d494793facc1dd45a6b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:28:48Z,use_quota=True,user_id='cbfc2f5d83554158b6853c220de433e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:28:48 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bab4a95-06df-4bcb-b7cf-239ef987d8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:28:48 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bab4a95-06df-4bcb-b7cf-239ef987d8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:28:48 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52683e87-cabf-4f5e-9f15-22d0c6a19373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:28:48 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52683e87-cabf-4f5e-9f15-22d0c6a19373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c77b83d5-cce7-4111-b244-a203d665087d', 'volume_name': 'volume-c77b83d5-cce7-4111-b244-a203d665087d', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:28:48 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef93a1fe-0cf9-480e-ac8f-05cab264e459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:28:48 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef93a1fe-0cf9-480e-ac8f-05cab264e459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:28:48 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae01cc5b-4d01-4e58-b094-fe036562251a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:28:48 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Volume c77b83d5-cce7-4111-b244-a203d665087d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c77b83d5-cce7-4111-b244-a203d665087d', 'volume_size': 1} Sep 10 15:28:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:28:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:28:48 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1406906461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c77b83d5-cce7-4111-b244-a203d665087d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba2ff20d484d494793facc1dd45a6b21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:28:48Z,use_quota=True,user_id='cbfc2f5d83554158b6853c220de433e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:28:48 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Creating volume c77b83d5-cce7-4111-b244-a203d665087d {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:28:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:28:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:28:48 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:28:48 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:28:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:28:48 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:28:48 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:28:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c77b83d5-cce7-4111-b244-a203d665087d 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:28:49 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=13, name=volume-c77b83d5-cce7-4111-b244-a203d665087d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:28:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c77b83d5-cce7-4111-b244-a203d665087d 1073741824" returned: 0 in 0.721s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:28:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c77b83d5-cce7-4111-b244-a203d665087d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:28:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c77b83d5-cce7-4111-b244-a203d665087d" returned: 0 in 0.140s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:28:49 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] <== create_volume: return (970ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:28:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:28:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae01cc5b-4d01-4e58-b094-fe036562251a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c77b83d5-cce7-4111-b244-a203d665087d', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:28:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b49d88-1d40-4028-a85a-d4b0cf6b0d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:28:50 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Volume volume-c77b83d5-cce7-4111-b244-a203d665087d (c77b83d5-cce7-4111-b244-a203d665087d): created successfully Sep 10 15:28:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b49d88-1d40-4028-a85a-d4b0cf6b0d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:28:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Flow 'volume_create_manager' (596611bd-a958-4d2a-a93d-79a57afd3229) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:28:50 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-281060ef-1037-453e-ad04-1c489ed37891 tempest-AttachVolumeTestJSON-1441596863 None] Created volume successfully. Sep 10 15:28:54 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:28:54 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:28:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Flow 'volume_create_manager' (47a9e434-e3ed-4c07-881b-f5fcdf92290e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:28:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089b12c2-c6ec-49d2-ae92-1d32ca2037bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:28:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (089b12c2-c6ec-49d2-ae92-1d32ca2037bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2128612915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c9ff451-0a41-4051-aeda-9819169b1685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d6ca04469a4f81aff713ecd839f270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:28:54Z,use_quota=True,user_id='587d9ea7985d45edbaee7cbb3b45e11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:28:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06553f90-c4d9-4349-b37e-5464261f2310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:28:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06553f90-c4d9-4349-b37e-5464261f2310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:28:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc760651-af86-466c-9b04-22bd94405575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:28:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc760651-af86-466c-9b04-22bd94405575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c9ff451-0a41-4051-aeda-9819169b1685', 'volume_name': 'volume-8c9ff451-0a41-4051-aeda-9819169b1685', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:28:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a2558ac-11cb-4646-9d32-ac0589cb5bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:28:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a2558ac-11cb-4646-9d32-ac0589cb5bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:28:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e48544fd-3b2f-49c6-aae8-3e3444e6fd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:28:54 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Volume 8c9ff451-0a41-4051-aeda-9819169b1685: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c9ff451-0a41-4051-aeda-9819169b1685', 'volume_size': 1} Sep 10 15:28:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:28:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:28:54 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:28:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2128612915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c9ff451-0a41-4051-aeda-9819169b1685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d6ca04469a4f81aff713ecd839f270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:28:54Z,use_quota=True,user_id='587d9ea7985d45edbaee7cbb3b45e11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:28:54 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Creating volume 8c9ff451-0a41-4051-aeda-9819169b1685 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:28:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:28:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:28:54 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:28:54 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:28:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:28:54 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:28:54 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:28:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c9ff451-0a41-4051-aeda-9819169b1685 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:28:54 devstack quobyte-client[82814]: System call of process 90486 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:28:55 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=14, name=volume-8c9ff451-0a41-4051-aeda-9819169b1685, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:28:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c9ff451-0a41-4051-aeda-9819169b1685 1073741824" returned: 0 in 0.554s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:28:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c9ff451-0a41-4051-aeda-9819169b1685 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:28:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c9ff451-0a41-4051-aeda-9819169b1685" returned: 0 in 0.334s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:28:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-47179dd3-929a-4bcb-bf12-74e626720d62 req-7d2f69f8-71fc-47ad-8022-3e9f754e31e7 tempest-AttachVolumeTestJSON-1441596863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:28:55 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] <== create_volume: return (945ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:28:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:28:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-47179dd3-929a-4bcb-bf12-74e626720d62 req-7d2f69f8-71fc-47ad-8022-3e9f754e31e7 tempest-AttachVolumeTestJSON-1441596863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.027s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:28:55 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcea0ec-45e8-4c72-be61-8c029d3f4808]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:28:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-47179dd3-929a-4bcb-bf12-74e626720d62 req-7d2f69f8-71fc-47ad-8022-3e9f754e31e7 tempest-AttachVolumeTestJSON-1441596863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c77b83d5-cce7-4111-b244-a203d665087d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:28:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e48544fd-3b2f-49c6-aae8-3e3444e6fd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c9ff451-0a41-4051-aeda-9819169b1685', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:28:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba1fb04d-7c3f-4886-823d-62c8bf5dd02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:28:56 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Volume volume-8c9ff451-0a41-4051-aeda-9819169b1685 (8c9ff451-0a41-4051-aeda-9819169b1685): created successfully Sep 10 15:28:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba1fb04d-7c3f-4886-823d-62c8bf5dd02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:28:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Flow 'volume_create_manager' (47a9e434-e3ed-4c07-881b-f5fcdf92290e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:28:56 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-075bbdb6-ea1a-4b4d-a538-667d4e3c5933 tempest-ServersNegativeTestJSON-669089031 None] Created volume successfully. Sep 10 15:28:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-47179dd3-929a-4bcb-bf12-74e626720d62 req-7d2f69f8-71fc-47ad-8022-3e9f754e31e7 tempest-AttachVolumeTestJSON-1441596863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c77b83d5-cce7-4111-b244-a203d665087d" returned: 0 in 0.516s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:28:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-47179dd3-929a-4bcb-bf12-74e626720d62 req-7d2f69f8-71fc-47ad-8022-3e9f754e31e7 tempest-AttachVolumeTestJSON-1441596863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.554s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:28:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-47179dd3-929a-4bcb-bf12-74e626720d62 req-7d2f69f8-71fc-47ad-8022-3e9f754e31e7 tempest-AttachVolumeTestJSON-1441596863 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5', 'name': 'volume-c77b83d5-cce7-4111-b244-a203d665087d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4737ee36-2cc5-45d1-88ef-818ed2647bf4', 'enforce_multipath': True} {{(pid=82800) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 15:28:56 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-47179dd3-929a-4bcb-bf12-74e626720d62 req-7d2f69f8-71fc-47ad-8022-3e9f754e31e7 tempest-AttachVolumeTestJSON-1441596863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:28:56 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-47179dd3-929a-4bcb-bf12-74e626720d62 req-7d2f69f8-71fc-47ad-8022-3e9f754e31e7 tempest-AttachVolumeTestJSON-1441596863 None] attachment_update completed successfully. Sep 10 15:28:58 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:28:58 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:28:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Flow 'volume_create_manager' (d2de86d5-5e67-4ce5-99f9-6d8eceb4b364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:28:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b18e0d-9c51-4ac8-87b7-d87c1fad7c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:28:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b18e0d-9c51-4ac8-87b7-d87c1fad7c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1687552482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f09c2b-c242-4279-b602-3ac625a194a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d6ca04469a4f81aff713ecd839f270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:28:58Z,use_quota=True,user_id='587d9ea7985d45edbaee7cbb3b45e11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:28:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (621ecc4a-0728-48f0-86d7-f1da505247c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:28:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (621ecc4a-0728-48f0-86d7-f1da505247c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:28:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff6faf6d-3b0d-46a6-bcc5-7f0a72200f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:28:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff6faf6d-3b0d-46a6-bcc5-7f0a72200f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53f09c2b-c242-4279-b602-3ac625a194a9', 'volume_name': 'volume-53f09c2b-c242-4279-b602-3ac625a194a9', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:28:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2deafea-cf58-4184-9bdf-4469de48555e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:28:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2deafea-cf58-4184-9bdf-4469de48555e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:28:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b047edc0-3e0f-4ff2-9c76-db97fd830499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:28:58 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Volume 53f09c2b-c242-4279-b602-3ac625a194a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53f09c2b-c242-4279-b602-3ac625a194a9', 'volume_size': 1} Sep 10 15:28:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:28:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:28:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1687552482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53f09c2b-c242-4279-b602-3ac625a194a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35d6ca04469a4f81aff713ecd839f270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:28:58Z,use_quota=True,user_id='587d9ea7985d45edbaee7cbb3b45e11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:28:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Creating volume 53f09c2b-c242-4279-b602-3ac625a194a9 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:28:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:28:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:28:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:28:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:28:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:28:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:28:58 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:28:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-53f09c2b-c242-4279-b602-3ac625a194a9 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:28:58 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=15, name=volume-53f09c2b-c242-4279-b602-3ac625a194a9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:28:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-53f09c2b-c242-4279-b602-3ac625a194a9 1073741824" returned: 0 in 0.470s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:28:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-53f09c2b-c242-4279-b602-3ac625a194a9 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:28:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-53f09c2b-c242-4279-b602-3ac625a194a9" returned: 0 in 0.157s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:28:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] <== create_volume: return (721ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:28:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:28:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b047edc0-3e0f-4ff2-9c76-db97fd830499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53f09c2b-c242-4279-b602-3ac625a194a9', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:28:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (589b390c-d31b-44c6-9ed5-cb05c67d6fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:28:59 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Volume volume-53f09c2b-c242-4279-b602-3ac625a194a9 (53f09c2b-c242-4279-b602-3ac625a194a9): created successfully Sep 10 15:28:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (589b390c-d31b-44c6-9ed5-cb05c67d6fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:28:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Flow 'volume_create_manager' (d2de86d5-5e67-4ce5-99f9-6d8eceb4b364) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:28:59 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-42a132b9-50f7-444e-b2db-458e958b848a tempest-ServersNegativeTestJSON-669089031 None] Created volume successfully. Sep 10 15:29:00 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e08661c9-c4d6-4114-8f38-331e596f257e tempest-ServersNegativeTestJSON-669089031 None] Acquiring lock "cinder-53f09c2b-c242-4279-b602-3ac625a194a9-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:29:00 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e08661c9-c4d6-4114-8f38-331e596f257e tempest-ServersNegativeTestJSON-669089031 None] Lock "cinder-53f09c2b-c242-4279-b602-3ac625a194a9-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:29:01 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-e08661c9-c4d6-4114-8f38-331e596f257e tempest-ServersNegativeTestJSON-669089031 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:29:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e08661c9-c4d6-4114-8f38-331e596f257e tempest-ServersNegativeTestJSON-669089031 None] Acquiring lock "cinder-quobyte-53f09c2b-c242-4279-b602-3ac625a194a9" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:29:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e08661c9-c4d6-4114-8f38-331e596f257e tempest-ServersNegativeTestJSON-669089031 None] Lock "cinder-quobyte-53f09c2b-c242-4279-b602-3ac625a194a9" acquired by "delete_volume" :: waited 0.020s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:29:01 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da01657-19d2-4aab-9dab-1eb4956bda52]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:29:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e08661c9-c4d6-4114-8f38-331e596f257e tempest-ServersNegativeTestJSON-669089031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-53f09c2b-c242-4279-b602-3ac625a194a9 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:29:01 devstack quobyte-client[82814]: System call of process 90529 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:29:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e08661c9-c4d6-4114-8f38-331e596f257e tempest-ServersNegativeTestJSON-669089031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-53f09c2b-c242-4279-b602-3ac625a194a9" returned: 0 in 0.588s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:29:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e08661c9-c4d6-4114-8f38-331e596f257e tempest-ServersNegativeTestJSON-669089031 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-53f09c2b-c242-4279-b602-3ac625a194a9 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:29:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e08661c9-c4d6-4114-8f38-331e596f257e tempest-ServersNegativeTestJSON-669089031 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-53f09c2b-c242-4279-b602-3ac625a194a9" returned: 0 in 0.123s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:29:02 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e08661c9-c4d6-4114-8f38-331e596f257e tempest-ServersNegativeTestJSON-669089031 None] Lock "cinder-quobyte-53f09c2b-c242-4279-b602-3ac625a194a9" released by "delete_volume" :: held 0.986s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:29:02 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-e08661c9-c4d6-4114-8f38-331e596f257e tempest-ServersNegativeTestJSON-669089031 None] Created reservations ['17aeceec-be34-454c-b3e4-efe8f811d947', '407b9355-1bcd-411c-9464-18b7568c69f6', 'e021ca3d-ef4d-4a1c-80a5-66effd9bbe6c', 'ef140d07-e572-43ac-b992-94eabefbfaa3'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:29:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e08661c9-c4d6-4114-8f38-331e596f257e tempest-ServersNegativeTestJSON-669089031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:29:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e08661c9-c4d6-4114-8f38-331e596f257e tempest-ServersNegativeTestJSON-669089031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:29:02 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e08661c9-c4d6-4114-8f38-331e596f257e tempest-ServersNegativeTestJSON-669089031 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:29:02 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e08661c9-c4d6-4114-8f38-331e596f257e tempest-ServersNegativeTestJSON-669089031 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:29:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e08661c9-c4d6-4114-8f38-331e596f257e tempest-ServersNegativeTestJSON-669089031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:29:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e08661c9-c4d6-4114-8f38-331e596f257e tempest-ServersNegativeTestJSON-669089031 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:29:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e08661c9-c4d6-4114-8f38-331e596f257e tempest-ServersNegativeTestJSON-669089031 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.162s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:29:02 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-e08661c9-c4d6-4114-8f38-331e596f257e tempest-ServersNegativeTestJSON-669089031 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:29:03 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-e08661c9-c4d6-4114-8f38-331e596f257e tempest-ServersNegativeTestJSON-669089031 None] Deleted volume successfully. Sep 10 15:29:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c46f1ac5-0c40-48e3-9584-e787ab06e1cf tempest-ServersNegativeTestJSON-669089031 None] Acquiring lock "cinder-8c9ff451-0a41-4051-aeda-9819169b1685-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:29:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c46f1ac5-0c40-48e3-9584-e787ab06e1cf tempest-ServersNegativeTestJSON-669089031 None] Lock "cinder-8c9ff451-0a41-4051-aeda-9819169b1685-delete_volume" acquired by "delete_volume" :: waited 0.172s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:29:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e08661c9-c4d6-4114-8f38-331e596f257e tempest-ServersNegativeTestJSON-669089031 None] Lock "cinder-53f09c2b-c242-4279-b602-3ac625a194a9-delete_volume" released by "delete_volume" :: held 2.687s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:29:03 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-c46f1ac5-0c40-48e3-9584-e787ab06e1cf tempest-ServersNegativeTestJSON-669089031 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:29:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c46f1ac5-0c40-48e3-9584-e787ab06e1cf tempest-ServersNegativeTestJSON-669089031 None] Acquiring lock "cinder-quobyte-8c9ff451-0a41-4051-aeda-9819169b1685" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:29:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c46f1ac5-0c40-48e3-9584-e787ab06e1cf tempest-ServersNegativeTestJSON-669089031 None] Lock "cinder-quobyte-8c9ff451-0a41-4051-aeda-9819169b1685" acquired by "delete_volume" :: waited 0.034s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:29:04 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[7191c882-ab0a-4976-8bc4-936c5a50929a]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:29:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c46f1ac5-0c40-48e3-9584-e787ab06e1cf tempest-ServersNegativeTestJSON-669089031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c9ff451-0a41-4051-aeda-9819169b1685 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:29:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c46f1ac5-0c40-48e3-9584-e787ab06e1cf tempest-ServersNegativeTestJSON-669089031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c9ff451-0a41-4051-aeda-9819169b1685" returned: 0 in 0.646s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:29:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c46f1ac5-0c40-48e3-9584-e787ab06e1cf tempest-ServersNegativeTestJSON-669089031 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c9ff451-0a41-4051-aeda-9819169b1685 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:29:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c46f1ac5-0c40-48e3-9584-e787ab06e1cf tempest-ServersNegativeTestJSON-669089031 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c9ff451-0a41-4051-aeda-9819169b1685" returned: 0 in 0.134s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:29:04 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c46f1ac5-0c40-48e3-9584-e787ab06e1cf tempest-ServersNegativeTestJSON-669089031 None] Lock "cinder-quobyte-8c9ff451-0a41-4051-aeda-9819169b1685" released by "delete_volume" :: held 0.986s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:29:05 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-c46f1ac5-0c40-48e3-9584-e787ab06e1cf tempest-ServersNegativeTestJSON-669089031 None] Created reservations ['22ba6e2b-da1e-4edc-a26b-0043453155b2', '6bb962ba-bd38-4f34-bef2-1b578afa2d65', '671fb246-ab55-4b3a-ac78-b54a69b5c602', '2ea13850-9aee-4cb4-bba9-cabcbae141d5'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:29:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c46f1ac5-0c40-48e3-9584-e787ab06e1cf tempest-ServersNegativeTestJSON-669089031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:29:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c46f1ac5-0c40-48e3-9584-e787ab06e1cf tempest-ServersNegativeTestJSON-669089031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:29:05 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c46f1ac5-0c40-48e3-9584-e787ab06e1cf tempest-ServersNegativeTestJSON-669089031 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:29:05 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c46f1ac5-0c40-48e3-9584-e787ab06e1cf tempest-ServersNegativeTestJSON-669089031 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:29:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c46f1ac5-0c40-48e3-9584-e787ab06e1cf tempest-ServersNegativeTestJSON-669089031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:29:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c46f1ac5-0c40-48e3-9584-e787ab06e1cf tempest-ServersNegativeTestJSON-669089031 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:29:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c46f1ac5-0c40-48e3-9584-e787ab06e1cf tempest-ServersNegativeTestJSON-669089031 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.170s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:29:06 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-c46f1ac5-0c40-48e3-9584-e787ab06e1cf tempest-ServersNegativeTestJSON-669089031 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:29:06 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-c46f1ac5-0c40-48e3-9584-e787ab06e1cf tempest-ServersNegativeTestJSON-669089031 None] Deleted volume successfully. Sep 10 15:29:06 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c46f1ac5-0c40-48e3-9584-e787ab06e1cf tempest-ServersNegativeTestJSON-669089031 None] Lock "cinder-8c9ff451-0a41-4051-aeda-9819169b1685-delete_volume" released by "delete_volume" :: held 3.413s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:29:15 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=21,cinder:UPDATE=19,cinder:DELETE=2,cinder:INSERT=7 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:29:16 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=29,cinder:SELECT=17,cinder:DELETE=3,cinder:INSERT=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:29:19 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:29:19 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:29:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Flow 'volume_create_manager' (2bee0174-fd2c-4b5b-ba5b-846c7eb7b047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:29:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a28f5210-bdcd-4f28-b117-d3b6d6fcc368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:29:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a28f5210-bdcd-4f28-b117-d3b6d6fcc368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1651645302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac56de2-07b7-4af9-989b-d733c463c29e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f230d5fc6de3464d9bada4e16bef2d12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:29:20Z,use_quota=True,user_id='6bf3f8597a6449d09d77f9ee97d8dc22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:29:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da69a73-5050-44f4-865c-0f5349599be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:29:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da69a73-5050-44f4-865c-0f5349599be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:29:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06400a6b-5046-462f-8c34-2c95569ec95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:29:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06400a6b-5046-462f-8c34-2c95569ec95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fac56de2-07b7-4af9-989b-d733c463c29e', 'volume_name': 'volume-fac56de2-07b7-4af9-989b-d733c463c29e', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:29:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3251d15-fde0-4a7d-9385-f94cec702ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:29:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3251d15-fde0-4a7d-9385-f94cec702ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:29:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be5cfbf-0ca0-4d44-a4c3-74492bb10188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:29:20 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Volume fac56de2-07b7-4af9-989b-d733c463c29e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fac56de2-07b7-4af9-989b-d733c463c29e', 'volume_size': 1} Sep 10 15:29:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:29:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:29:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1651645302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac56de2-07b7-4af9-989b-d733c463c29e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f230d5fc6de3464d9bada4e16bef2d12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:29:20Z,use_quota=True,user_id='6bf3f8597a6449d09d77f9ee97d8dc22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:29:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Creating volume fac56de2-07b7-4af9-989b-d733c463c29e {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:29:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:29:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:29:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:29:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:29:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:29:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:29:20 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:29:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-fac56de2-07b7-4af9-989b-d733c463c29e 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:29:20 devstack quobyte-client[82814]: System call of process 90660 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:29:20 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=16, name=volume-fac56de2-07b7-4af9-989b-d733c463c29e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:29:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-fac56de2-07b7-4af9-989b-d733c463c29e 1073741824" returned: 0 in 0.672s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:29:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-fac56de2-07b7-4af9-989b-d733c463c29e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:29:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-fac56de2-07b7-4af9-989b-d733c463c29e" returned: 0 in 0.355s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:29:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] <== create_volume: return (1369ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:29:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:29:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be5cfbf-0ca0-4d44-a4c3-74492bb10188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fac56de2-07b7-4af9-989b-d733c463c29e', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:29:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb041c3-df11-4692-b1a7-e196c44699f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:29:21 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Volume volume-fac56de2-07b7-4af9-989b-d733c463c29e (fac56de2-07b7-4af9-989b-d733c463c29e): created successfully Sep 10 15:29:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb041c3-df11-4692-b1a7-e196c44699f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:29:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Flow 'volume_create_manager' (2bee0174-fd2c-4b5b-ba5b-846c7eb7b047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:29:21 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-0a15126e-29bd-42e3-8070-928c0daaeeb5 tempest-AttachVolumeShelveTestJSON-83004131 None] Created volume successfully. Sep 10 15:29:27 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-e62deeed-761f-4c5e-ac56-7ee7f5a8915f req-be43b933-1d86-4089-9c46-304ba9f0b3e8 tempest-AttachVolumeTestJSON-1441596863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:29:27 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-e62deeed-761f-4c5e-ac56-7ee7f5a8915f req-be43b933-1d86-4089-9c46-304ba9f0b3e8 tempest-AttachVolumeTestJSON-1441596863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:29:27 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-e62deeed-761f-4c5e-ac56-7ee7f5a8915f req-be43b933-1d86-4089-9c46-304ba9f0b3e8 tempest-AttachVolumeTestJSON-1441596863 None] Terminate volume connection completed successfully. Sep 10 15:29:27 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-e62deeed-761f-4c5e-ac56-7ee7f5a8915f req-be43b933-1d86-4089-9c46-304ba9f0b3e8 tempest-AttachVolumeTestJSON-1441596863 None] Deleting attachment 8bd770ae-e479-4447-9bd3-74b2e24e9748. {{(pid=82800) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 15:29:28 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:29:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:29:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:29:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:29:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:29:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:29:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:29:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.455s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:29:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:29:32 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:29:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-4489050b-6ecc-40ec-9ddb-8bc7b24fb6c4 tempest-BackendsCapabilitiesAdminTestsJSON-461350264 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.914478302002, 'free_capacity_gb': 924.914478302002, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82800) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 10 15:29:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-5751628c-01c0-499c-af91-741cbda14bc9 tempest-BackendsCapabilitiesAdminTestsJSON-461350264 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.914478302002, 'free_capacity_gb': 924.914478302002, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82800) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 10 15:29:37 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:29:43 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-4fb8f3a0-0083-4f41-8f38-3195e310a280 tempest-GroupSnapshotsTest-829329676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:29:43 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-4fb8f3a0-0083-4f41-8f38-3195e310a280 tempest-GroupSnapshotsTest-829329676 None] Group tempest-GroupSnapshotsTest-Group-1992224003: creating Sep 10 15:29:43 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-4fb8f3a0-0083-4f41-8f38-3195e310a280 tempest-GroupSnapshotsTest-829329676 None] Group tempest-GroupSnapshotsTest-Group-1992224003: created successfully Sep 10 15:29:43 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-4fb8f3a0-0083-4f41-8f38-3195e310a280 tempest-GroupSnapshotsTest-829329676 None] Create group completed successfully. Sep 10 15:29:45 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:29:45 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:29:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Flow 'volume_create_manager' (f253511f-a98f-4c07-a994-7921e1c33dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:29:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d41679-3d3e-4be7-b245-83ad0a088ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:29:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d41679-3d3e-4be7-b245-83ad0a088ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-454759579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=590a98a5-f9cf-438c-8a2d-0c03684fd40e,host='devstack@QuobyteHD#QuobyteHD',id=2b4234bb-fade-4841-aa45-1abb1f7a4da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90d78fb80fca4cb4b7eed18607551ae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:29:45Z,use_quota=True,user_id='61184f76f06c408982d044bb6dc422b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1218be95-50a0-4903-89e5-94446e061109),volume_type_id=1218be95-50a0-4903-89e5-94446e061109)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:29:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a5941dd-348f-4b57-9574-5a8550f1106a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:29:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a5941dd-348f-4b57-9574-5a8550f1106a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:29:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73c7684-6daa-4ce1-9a88-2f19960b1216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:29:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73c7684-6daa-4ce1-9a88-2f19960b1216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b4234bb-fade-4841-aa45-1abb1f7a4da5', 'volume_name': 'volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:29:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65df280-6fc6-494e-88ce-870aa25d9b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:29:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65df280-6fc6-494e-88ce-870aa25d9b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:29:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43585418-eb2e-4b9f-8323-c041442e88c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:29:45 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Volume 2b4234bb-fade-4841-aa45-1abb1f7a4da5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5', 'volume_size': 1} Sep 10 15:29:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:29:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:29:45 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=590a98a5-f9cf-438c-8a2d-0c03684fd40e,created_at=2025-09-10T13:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-454759579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=590a98a5-f9cf-438c-8a2d-0c03684fd40e,host='devstack@QuobyteHD#QuobyteHD',id=2b4234bb-fade-4841-aa45-1abb1f7a4da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90d78fb80fca4cb4b7eed18607551ae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:29:45Z,use_quota=True,user_id='61184f76f06c408982d044bb6dc422b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1218be95-50a0-4903-89e5-94446e061109),volume_type_id=1218be95-50a0-4903-89e5-94446e061109)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:29:45 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Creating volume 2b4234bb-fade-4841-aa45-1abb1f7a4da5 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:29:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:29:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:29:45 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:29:45 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:29:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:29:45 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:29:45 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:29:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:29:45 devstack quobyte-client[82814]: System call of process 90739 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:29:45 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=17, name=volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:29:46 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-c9cbd147-0569-4945-9846-128a0316748b req-1faa9f75-39f3-4d31-9dc2-c4ff5cec68e2 tempest-AttachVolumeShelveTestJSON-83004131 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:29:46 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-c9cbd147-0569-4945-9846-128a0316748b req-1faa9f75-39f3-4d31-9dc2-c4ff5cec68e2 tempest-AttachVolumeShelveTestJSON-83004131 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:29:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-c9cbd147-0569-4945-9846-128a0316748b req-1faa9f75-39f3-4d31-9dc2-c4ff5cec68e2 tempest-AttachVolumeShelveTestJSON-83004131 None] No connector for attachment 4cd1f88e-706b-4ddc-aa16-93367c11eef1; skipping storage backend terminate_connection call. {{(pid=82800) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}} Sep 10 15:29:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-c9cbd147-0569-4945-9846-128a0316748b req-1faa9f75-39f3-4d31-9dc2-c4ff5cec68e2 tempest-AttachVolumeShelveTestJSON-83004131 None] Deleting attachment 4cd1f88e-706b-4ddc-aa16-93367c11eef1. {{(pid=82800) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 15:29:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5 1073741824" returned: 0 in 0.620s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:29:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:29:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5" returned: 0 in 0.151s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:29:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] <== create_volume: return (824ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:29:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:29:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43585418-eb2e-4b9f-8323-c041442e88c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:29:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d8ce36-5eea-40a4-b2d2-be918fc494f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:29:46 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Volume volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5 (2b4234bb-fade-4841-aa45-1abb1f7a4da5): created successfully Sep 10 15:29:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d8ce36-5eea-40a4-b2d2-be918fc494f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:29:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Flow 'volume_create_manager' (f253511f-a98f-4c07-a994-7921e1c33dd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:29:46 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-7976be74-7c04-405a-a19c-eaaa0c51f6ca tempest-GroupSnapshotsTest-829329676 None] Created volume successfully. Sep 10 15:29:48 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-52beb2e3-5475-4c3b-8d9f-87671abde8d7 tempest-GroupSnapshotsTest-829329676 None] GroupSnapshot c9e31eaf-ba9b-4f18-ac3d-4ba9cbcb2e72: creating. Sep 10 15:29:48 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-52beb2e3-5475-4c3b-8d9f-87671abde8d7 tempest-GroupSnapshotsTest-829329676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:29:48 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-52beb2e3-5475-4c3b-8d9f-87671abde8d7 tempest-GroupSnapshotsTest-829329676 None] Group snapshot c9e31eaf-ba9b-4f18-ac3d-4ba9cbcb2e72: creating. {{(pid=82800) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 10 15:29:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-52beb2e3-5475-4c3b-8d9f-87671abde8d7 tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:29:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-52beb2e3-5475-4c3b-8d9f-87671abde8d7 tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:29:48 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-52beb2e3-5475-4c3b-8d9f-87671abde8d7 tempest-GroupSnapshotsTest-829329676 None] Creating offline snapshot 31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b of volume 2b4234bb-fade-4841-aa45-1abb1f7a4da5 {{(pid=82800) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 15:29:48 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a062db3-39ae-4e09-a404-846845429791]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:29:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-52beb2e3-5475-4c3b-8d9f-87671abde8d7 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:29:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-52beb2e3-5475-4c3b-8d9f-87671abde8d7 tempest-GroupSnapshotsTest-829329676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5" returned: 0 in 0.554s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:29:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-52beb2e3-5475-4c3b-8d9f-87671abde8d7 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5.31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:29:49 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=18, name=volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5.31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:29:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-52beb2e3-5475-4c3b-8d9f-87671abde8d7 tempest-GroupSnapshotsTest-829329676 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5.31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b 1G" returned: 0 in 0.260s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:29:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-52beb2e3-5475-4c3b-8d9f-87671abde8d7 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5.31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:29:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-52beb2e3-5475-4c3b-8d9f-87671abde8d7 tempest-GroupSnapshotsTest-829329676 None] CMD "qemu-img rebase -u -b volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5.31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b" returned: 0 in 0.147s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:29:49 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-52beb2e3-5475-4c3b-8d9f-87671abde8d7 tempest-GroupSnapshotsTest-829329676 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5.31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:29:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-52beb2e3-5475-4c3b-8d9f-87671abde8d7 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5.31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:29:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-52beb2e3-5475-4c3b-8d9f-87671abde8d7 tempest-GroupSnapshotsTest-829329676 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5.31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b" returned: 0 in 0.107s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:29:49 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-52beb2e3-5475-4c3b-8d9f-87671abde8d7 tempest-GroupSnapshotsTest-829329676 None] Setting permissions: /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5 -> 1000:1000 {{(pid=82800) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 15:29:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-52beb2e3-5475-4c3b-8d9f-87671abde8d7 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5.31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:29:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-52beb2e3-5475-4c3b-8d9f-87671abde8d7 tempest-GroupSnapshotsTest-829329676 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5.31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b" returned: 0 in 0.133s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:29:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-52beb2e3-5475-4c3b-8d9f-87671abde8d7 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:29:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-52beb2e3-5475-4c3b-8d9f-87671abde8d7 tempest-GroupSnapshotsTest-829329676 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5.info" returned: 0 in 0.095s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:29:50 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-52beb2e3-5475-4c3b-8d9f-87671abde8d7 tempest-GroupSnapshotsTest-829329676 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5.info is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:29:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-52beb2e3-5475-4c3b-8d9f-87671abde8d7 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:29:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-52beb2e3-5475-4c3b-8d9f-87671abde8d7 tempest-GroupSnapshotsTest-829329676 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5.info" returned: 0 in 0.084s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:29:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-52beb2e3-5475-4c3b-8d9f-87671abde8d7 tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.697s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:29:50 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-52beb2e3-5475-4c3b-8d9f-87671abde8d7 tempest-GroupSnapshotsTest-829329676 None] group_snapshot c9e31eaf-ba9b-4f18-ac3d-4ba9cbcb2e72: created successfully Sep 10 15:29:52 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-8e131eec-b727-4ad6-8f85-6873c0c16c05 req-bd14fbe4-58a4-4ec0-9cf3-6e022fa36730 tempest-AttachVolumeTestJSON-1441596863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:29:53 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-8e131eec-b727-4ad6-8f85-6873c0c16c05 req-bd14fbe4-58a4-4ec0-9cf3-6e022fa36730 tempest-AttachVolumeTestJSON-1441596863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:29:53 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-8e131eec-b727-4ad6-8f85-6873c0c16c05 req-bd14fbe4-58a4-4ec0-9cf3-6e022fa36730 tempest-AttachVolumeTestJSON-1441596863 None] Terminate volume connection completed successfully. Sep 10 15:29:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-8e131eec-b727-4ad6-8f85-6873c0c16c05 req-bd14fbe4-58a4-4ec0-9cf3-6e022fa36730 tempest-AttachVolumeTestJSON-1441596863 None] Deleting attachment 4737ee36-2cc5-45d1-88ef-818ed2647bf4. {{(pid=82800) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 15:29:53 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:29:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:29:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:29:53 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "cinder-quobyte-31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b-833da36a-e9b2-4202-a068-59119b3b774a" by "_create_volume_from_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:29:53 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b-833da36a-e9b2-4202-a068-59119b3b774a" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:29:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Creating volume 833da36a-e9b2-4202-a068-59119b3b774a from snapshot 31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b {{(pid=82800) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 10 15:29:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:29:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:29:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:29:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:29:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:29:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:29:53 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "cinder-quobyte-833da36a-e9b2-4202-a068-59119b3b774a" by "_copy_volume_from_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:29:53 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-833da36a-e9b2-4202-a068-59119b3b774a" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:29:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] snapshot: 31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b, volume: 833da36a-e9b2-4202-a068-59119b3b774a, {{(pid=82800) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 10 15:29:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:29:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:29:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:29:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:29:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:29:53 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2fcc63-29f6-4e36-a7a5-0f2b34689152]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:29:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5.31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:29:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5.31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b" returned: 0 in 0.503s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:29:54 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:29:54 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5 {{(pid=82800) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 10 15:29:54 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Creating direct copy from snapshot {{(pid=82800) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 10 15:29:54 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f09a121-97a1-4e24-a3d5-dc3e52d115f0]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:29:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:29:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5" returned: 0 in 0.563s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:29:54 devstack cinder-volume[82800]: DEBUG cinder.utils [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-833da36a-e9b2-4202-a068-59119b3b774a not found in is_blk_device check {{(pid=82800) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 10 15:29:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-833da36a-e9b2-4202-a068-59119b3b774a {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:29:55 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=20, name=volume-833da36a-e9b2-4202-a068-59119b3b774a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:30:03 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:30:04 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=6,cinder:SELECT=13 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:30:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-833da36a-e9b2-4202-a068-59119b3b774a" returned: 0 in 10.091s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:04 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[0731661f-1af1-4124-a078-418f6b0c3824]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:30:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5" returned: 0 in 1.347s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:06 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Image conversion details: src /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5, size 1024.00 MB, duration 10.11 sec, destination /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-833da36a-e9b2-4202-a068-59119b3b774a {{(pid=82800) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 15:30:06 devstack cinder-volume[82800]: INFO cinder.image.image_utils [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Converted 1024.00 MB image at 101.26 MB/s Sep 10 15:30:06 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-833da36a-e9b2-4202-a068-59119b3b774a is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:30:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-833da36a-e9b2-4202-a068-59119b3b774a {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-833da36a-e9b2-4202-a068-59119b3b774a" returned: 0 in 0.166s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:06 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-833da36a-e9b2-4202-a068-59119b3b774a" released by "_copy_volume_from_snapshot" :: held 13.320s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:30:06 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b-833da36a-e9b2-4202-a068-59119b3b774a" released by "_create_volume_from_snapshot" :: held 13.369s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:30:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.419s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:30:07 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-11c8f15c-b8dd-4e3b-9396-4a234c53e2f3 tempest-GroupSnapshotsTest-829329676 None] Create group from source-snapshot-c9e31eaf-ba9b-4f18-ac3d-4ba9cbcb2e72 completed successfully. Sep 10 15:30:10 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-8fa5c3f2-a5db-4de5-a964-e2389271d75e tempest-GroupSnapshotsTest-829329676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:30:10 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-8fa5c3f2-a5db-4de5-a964-e2389271d75e tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "cinder-quobyte-833da36a-e9b2-4202-a068-59119b3b774a" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:30:10 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-8fa5c3f2-a5db-4de5-a964-e2389271d75e tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-833da36a-e9b2-4202-a068-59119b3b774a" acquired by "delete_volume" :: waited 0.038s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:30:10 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff40abe0-5735-4599-b52c-9b2207dfe5dd]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:30:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8fa5c3f2-a5db-4de5-a964-e2389271d75e tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-833da36a-e9b2-4202-a068-59119b3b774a {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:11 devstack quobyte-client[82814]: System call of process 90858 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:30:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8fa5c3f2-a5db-4de5-a964-e2389271d75e tempest-GroupSnapshotsTest-829329676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-833da36a-e9b2-4202-a068-59119b3b774a" returned: 0 in 0.986s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8fa5c3f2-a5db-4de5-a964-e2389271d75e tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-833da36a-e9b2-4202-a068-59119b3b774a {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8fa5c3f2-a5db-4de5-a964-e2389271d75e tempest-GroupSnapshotsTest-829329676 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-833da36a-e9b2-4202-a068-59119b3b774a" returned: 0 in 0.276s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:12 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-8fa5c3f2-a5db-4de5-a964-e2389271d75e tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-833da36a-e9b2-4202-a068-59119b3b774a" released by "delete_volume" :: held 1.727s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:30:13 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-8fa5c3f2-a5db-4de5-a964-e2389271d75e tempest-GroupSnapshotsTest-829329676 None] Created reservations ['b3258150-a34e-4834-abe9-ec0db775fa54'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:30:13 devstack cinder-volume[82800]: WARNING cinder.quota [None req-8fa5c3f2-a5db-4de5-a964-e2389271d75e tempest-GroupSnapshotsTest-829329676 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-280931146 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-280931146, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:30:13 devstack cinder-volume[82800]: WARNING cinder.quota [None req-8fa5c3f2-a5db-4de5-a964-e2389271d75e tempest-GroupSnapshotsTest-829329676 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-280931146 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-280931146, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:30:13 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-8fa5c3f2-a5db-4de5-a964-e2389271d75e tempest-GroupSnapshotsTest-829329676 None] Created reservations ['e3601815-69d6-49ba-982a-ed7e25c4690f', '42731913-e40f-441f-9f36-bddf723e702e', '8520b585-fd07-4d9e-bbb8-d446f62ea811', '89365c44-7b30-451d-a255-143fdcd7ccc3'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:30:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8fa5c3f2-a5db-4de5-a964-e2389271d75e tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:30:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8fa5c3f2-a5db-4de5-a964-e2389271d75e tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:30:14 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8fa5c3f2-a5db-4de5-a964-e2389271d75e tempest-GroupSnapshotsTest-829329676 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:30:14 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8fa5c3f2-a5db-4de5-a964-e2389271d75e tempest-GroupSnapshotsTest-829329676 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:30:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8fa5c3f2-a5db-4de5-a964-e2389271d75e tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:30:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8fa5c3f2-a5db-4de5-a964-e2389271d75e tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8fa5c3f2-a5db-4de5-a964-e2389271d75e tempest-GroupSnapshotsTest-829329676 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.361s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:15 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-8fa5c3f2-a5db-4de5-a964-e2389271d75e tempest-GroupSnapshotsTest-829329676 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:30:15 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-8fa5c3f2-a5db-4de5-a964-e2389271d75e tempest-GroupSnapshotsTest-829329676 None] Delete group completed successfully. Sep 10 15:30:15 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-40cd0060-daff-4d78-ae9a-767ec74b1922 tempest-GroupSnapshotsTest-829329676 None] group_snapshot c9e31eaf-ba9b-4f18-ac3d-4ba9cbcb2e72: deleting Sep 10 15:30:16 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-40cd0060-daff-4d78-ae9a-767ec74b1922 tempest-GroupSnapshotsTest-829329676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:30:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-40cd0060-daff-4d78-ae9a-767ec74b1922 tempest-GroupSnapshotsTest-829329676 None] group_snapshot c9e31eaf-ba9b-4f18-ac3d-4ba9cbcb2e72: deleting {{(pid=82800) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 10 15:30:16 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-40cd0060-daff-4d78-ae9a-767ec74b1922 tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "cinder-quobyte-2b4234bb-fade-4841-aa45-1abb1f7a4da5" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:30:16 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-40cd0060-daff-4d78-ae9a-767ec74b1922 tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-2b4234bb-fade-4841-aa45-1abb1f7a4da5" acquired by "delete_snapshot" :: waited 0.095s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:30:16 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-40cd0060-daff-4d78-ae9a-767ec74b1922 tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "cinder-quobyte-31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b" by "_delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:30:16 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-40cd0060-daff-4d78-ae9a-767ec74b1922 tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:30:16 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-40cd0060-daff-4d78-ae9a-767ec74b1922 tempest-GroupSnapshotsTest-829329676 None] Deleting offline snapshot 31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b of volume 2b4234bb-fade-4841-aa45-1abb1f7a4da5 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 15:30:16 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-40cd0060-daff-4d78-ae9a-767ec74b1922 tempest-GroupSnapshotsTest-829329676 None] snapshot_file for this snap is: volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5.31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 15:30:16 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0bb72a-598c-4a12-ac28-967051842dd9]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:30:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-40cd0060-daff-4d78-ae9a-767ec74b1922 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5.31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-40cd0060-daff-4d78-ae9a-767ec74b1922 tempest-GroupSnapshotsTest-829329676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5.31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b" returned: 0 in 1.191s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:18 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-40cd0060-daff-4d78-ae9a-767ec74b1922 tempest-GroupSnapshotsTest-829329676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:30:18 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fec39a1-b6f5-47f1-a62d-3d638d2e7ce6]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:30:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-40cd0060-daff-4d78-ae9a-767ec74b1922 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-40cd0060-daff-4d78-ae9a-767ec74b1922 tempest-GroupSnapshotsTest-829329676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5" returned: 0 in 1.013s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-40cd0060-daff-4d78-ae9a-767ec74b1922 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5.31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-40cd0060-daff-4d78-ae9a-767ec74b1922 tempest-GroupSnapshotsTest-829329676 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5.31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b" returned: 0 in 0.304s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-40cd0060-daff-4d78-ae9a-767ec74b1922 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5.31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-40cd0060-daff-4d78-ae9a-767ec74b1922 tempest-GroupSnapshotsTest-829329676 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5.31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b" returned: 0 in 0.278s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:20 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-40cd0060-daff-4d78-ae9a-767ec74b1922 tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-31f5dcd3-b8fc-474d-a9e0-78c3a64fc52b" released by "_delete_snapshot" :: held 3.597s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:30:20 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-40cd0060-daff-4d78-ae9a-767ec74b1922 tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-2b4234bb-fade-4841-aa45-1abb1f7a4da5" released by "delete_snapshot" :: held 3.654s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:30:20 devstack cinder-volume[82800]: WARNING cinder.quota [None req-40cd0060-daff-4d78-ae9a-767ec74b1922 tempest-GroupSnapshotsTest-829329676 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-280931146 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-280931146, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:30:20 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-40cd0060-daff-4d78-ae9a-767ec74b1922 tempest-GroupSnapshotsTest-829329676 None] Created reservations ['7968dbcc-306e-45a5-8d52-5f509f3b40b4', 'b2489dda-b068-4363-bddf-4195c74d872b', 'b082cf93-97bb-4cd1-9fe2-ffae616808f5', '2d03b916-3d15-448d-a773-adeeefd94f1e'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:30:21 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-40cd0060-daff-4d78-ae9a-767ec74b1922 tempest-GroupSnapshotsTest-829329676 None] group_snapshot c9e31eaf-ba9b-4f18-ac3d-4ba9cbcb2e72: deleted successfully Sep 10 15:30:22 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-d8eaf25f-8004-4ab4-93c0-2a93153b4030 tempest-GroupSnapshotsTest-829329676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:30:22 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d8eaf25f-8004-4ab4-93c0-2a93153b4030 tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "cinder-quobyte-2b4234bb-fade-4841-aa45-1abb1f7a4da5" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:30:22 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d8eaf25f-8004-4ab4-93c0-2a93153b4030 tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-2b4234bb-fade-4841-aa45-1abb1f7a4da5" acquired by "delete_volume" :: waited 0.037s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:30:22 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7d395e-2e42-4748-98fb-461c0d3f6232]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:30:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8eaf25f-8004-4ab4-93c0-2a93153b4030 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:23 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-6bc5d1ba-1722-4bee-8d5c-6c24f71eed08 tempest-AttachVolumeTestJSON-1441596863 None] Acquiring lock "cinder-c77b83d5-cce7-4111-b244-a203d665087d-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:30:23 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-6bc5d1ba-1722-4bee-8d5c-6c24f71eed08 tempest-AttachVolumeTestJSON-1441596863 None] Lock "cinder-c77b83d5-cce7-4111-b244-a203d665087d-delete_volume" acquired by "delete_volume" :: waited 0.139s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:30:23 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-6bc5d1ba-1722-4bee-8d5c-6c24f71eed08 tempest-AttachVolumeTestJSON-1441596863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:30:23 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-6bc5d1ba-1722-4bee-8d5c-6c24f71eed08 tempest-AttachVolumeTestJSON-1441596863 None] Acquiring lock "cinder-quobyte-c77b83d5-cce7-4111-b244-a203d665087d" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:30:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8eaf25f-8004-4ab4-93c0-2a93153b4030 tempest-GroupSnapshotsTest-829329676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5" returned: 0 in 1.003s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8eaf25f-8004-4ab4-93c0-2a93153b4030 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8eaf25f-8004-4ab4-93c0-2a93153b4030 tempest-GroupSnapshotsTest-829329676 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b4234bb-fade-4841-aa45-1abb1f7a4da5" returned: 0 in 0.277s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:24 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-6bc5d1ba-1722-4bee-8d5c-6c24f71eed08 tempest-AttachVolumeTestJSON-1441596863 None] Lock "cinder-quobyte-c77b83d5-cce7-4111-b244-a203d665087d" acquired by "delete_volume" :: waited 0.366s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:30:24 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d8eaf25f-8004-4ab4-93c0-2a93153b4030 tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-2b4234bb-fade-4841-aa45-1abb1f7a4da5" released by "delete_volume" :: held 1.486s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:30:24 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1b17a9-8b3f-4bc7-80b3-4d8f86bf9a33]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:30:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6bc5d1ba-1722-4bee-8d5c-6c24f71eed08 tempest-AttachVolumeTestJSON-1441596863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c77b83d5-cce7-4111-b244-a203d665087d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:25 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-d8eaf25f-8004-4ab4-93c0-2a93153b4030 tempest-GroupSnapshotsTest-829329676 None] Created reservations ['1ceaf0ce-7fda-457e-9495-96c3922b2d73'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:30:25 devstack quobyte-client[82814]: System call of process 90942 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:30:25 devstack cinder-volume[82800]: WARNING cinder.db.sqlalchemy.api [None req-d8eaf25f-8004-4ab4-93c0-2a93153b4030 tempest-GroupSnapshotsTest-829329676 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-280931146'] Sep 10 15:30:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6bc5d1ba-1722-4bee-8d5c-6c24f71eed08 tempest-AttachVolumeTestJSON-1441596863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c77b83d5-cce7-4111-b244-a203d665087d" returned: 0 in 0.834s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6bc5d1ba-1722-4bee-8d5c-6c24f71eed08 tempest-AttachVolumeTestJSON-1441596863 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c77b83d5-cce7-4111-b244-a203d665087d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:25 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-d8eaf25f-8004-4ab4-93c0-2a93153b4030 tempest-GroupSnapshotsTest-829329676 None] Created reservations ['0e31c087-75b2-4255-918e-c68bc10be66a', '5192b5d3-3a3e-4b7f-969d-9013e2f48a52', 'b99edb26-4c11-4336-ac01-27eb05a6a57b', 'ceadcd8e-10ad-499e-baed-270caf8b7fad'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:30:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6bc5d1ba-1722-4bee-8d5c-6c24f71eed08 tempest-AttachVolumeTestJSON-1441596863 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c77b83d5-cce7-4111-b244-a203d665087d" returned: 0 in 0.427s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:25 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-6bc5d1ba-1722-4bee-8d5c-6c24f71eed08 tempest-AttachVolumeTestJSON-1441596863 None] Lock "cinder-quobyte-c77b83d5-cce7-4111-b244-a203d665087d" released by "delete_volume" :: held 1.661s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:30:26 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-6bc5d1ba-1722-4bee-8d5c-6c24f71eed08 tempest-AttachVolumeTestJSON-1441596863 None] Created reservations ['bc88c566-35fe-4d69-939a-d71d62a46313', 'c360d7de-f319-4536-9a2a-f96a55fccc0f', 'badba682-0c5d-42b5-9e9f-7ef791de451a', '97422dfe-8b4b-429b-bab4-9a2445ae5a75'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:30:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d8eaf25f-8004-4ab4-93c0-2a93153b4030 tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:30:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d8eaf25f-8004-4ab4-93c0-2a93153b4030 tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:30:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d8eaf25f-8004-4ab4-93c0-2a93153b4030 tempest-GroupSnapshotsTest-829329676 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:30:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d8eaf25f-8004-4ab4-93c0-2a93153b4030 tempest-GroupSnapshotsTest-829329676 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:30:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d8eaf25f-8004-4ab4-93c0-2a93153b4030 tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:30:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8eaf25f-8004-4ab4-93c0-2a93153b4030 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8eaf25f-8004-4ab4-93c0-2a93153b4030 tempest-GroupSnapshotsTest-829329676 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.405s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:26 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-d8eaf25f-8004-4ab4-93c0-2a93153b4030 tempest-GroupSnapshotsTest-829329676 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:30:26 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-d8eaf25f-8004-4ab4-93c0-2a93153b4030 tempest-GroupSnapshotsTest-829329676 None] Delete group completed successfully. Sep 10 15:30:26 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-84f1f1fe-7de8-4ee5-ae46-df41d7c303b7 tempest-AttachVolumeTestJSON-1441596863 None] Acquiring lock "cinder-43f5dd56-28db-4ac9-a860-c7ed52132b68-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:30:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6bc5d1ba-1722-4bee-8d5c-6c24f71eed08 tempest-AttachVolumeTestJSON-1441596863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:30:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6bc5d1ba-1722-4bee-8d5c-6c24f71eed08 tempest-AttachVolumeTestJSON-1441596863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:30:27 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6bc5d1ba-1722-4bee-8d5c-6c24f71eed08 tempest-AttachVolumeTestJSON-1441596863 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:30:27 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6bc5d1ba-1722-4bee-8d5c-6c24f71eed08 tempest-AttachVolumeTestJSON-1441596863 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:30:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6bc5d1ba-1722-4bee-8d5c-6c24f71eed08 tempest-AttachVolumeTestJSON-1441596863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:30:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6bc5d1ba-1722-4bee-8d5c-6c24f71eed08 tempest-AttachVolumeTestJSON-1441596863 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6bc5d1ba-1722-4bee-8d5c-6c24f71eed08 tempest-AttachVolumeTestJSON-1441596863 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.388s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:27 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-6bc5d1ba-1722-4bee-8d5c-6c24f71eed08 tempest-AttachVolumeTestJSON-1441596863 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:30:27 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-6bc5d1ba-1722-4bee-8d5c-6c24f71eed08 tempest-AttachVolumeTestJSON-1441596863 None] Deleted volume successfully. Sep 10 15:30:27 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-84f1f1fe-7de8-4ee5-ae46-df41d7c303b7 tempest-AttachVolumeTestJSON-1441596863 None] Lock "cinder-43f5dd56-28db-4ac9-a860-c7ed52132b68-delete_volume" acquired by "delete_volume" :: waited 0.661s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:30:27 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-41ee295e-010c-411a-bedc-d5445f6fd85b tempest-GroupSnapshotsTest-829329676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:30:27 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-41ee295e-010c-411a-bedc-d5445f6fd85b tempest-GroupSnapshotsTest-829329676 None] Group tempest-GroupSnapshotsTest-Group-843016675: creating Sep 10 15:30:27 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-6bc5d1ba-1722-4bee-8d5c-6c24f71eed08 tempest-AttachVolumeTestJSON-1441596863 None] Lock "cinder-c77b83d5-cce7-4111-b244-a203d665087d-delete_volume" released by "delete_volume" :: held 4.483s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:30:27 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-84f1f1fe-7de8-4ee5-ae46-df41d7c303b7 tempest-AttachVolumeTestJSON-1441596863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:30:27 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-84f1f1fe-7de8-4ee5-ae46-df41d7c303b7 tempest-AttachVolumeTestJSON-1441596863 None] Acquiring lock "cinder-quobyte-43f5dd56-28db-4ac9-a860-c7ed52132b68" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:30:27 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-41ee295e-010c-411a-bedc-d5445f6fd85b tempest-GroupSnapshotsTest-829329676 None] Group tempest-GroupSnapshotsTest-Group-843016675: created successfully Sep 10 15:30:28 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-84f1f1fe-7de8-4ee5-ae46-df41d7c303b7 tempest-AttachVolumeTestJSON-1441596863 None] Lock "cinder-quobyte-43f5dd56-28db-4ac9-a860-c7ed52132b68" acquired by "delete_volume" :: waited 0.022s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:30:28 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-41ee295e-010c-411a-bedc-d5445f6fd85b tempest-GroupSnapshotsTest-829329676 None] Create group completed successfully. Sep 10 15:30:28 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ec1a66-700d-44d5-9f82-a5c8b084624e]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:30:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-84f1f1fe-7de8-4ee5-ae46-df41d7c303b7 tempest-AttachVolumeTestJSON-1441596863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-43f5dd56-28db-4ac9-a860-c7ed52132b68 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:28 devstack quobyte-client[82814]: System call of process 90953 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:30:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-84f1f1fe-7de8-4ee5-ae46-df41d7c303b7 tempest-AttachVolumeTestJSON-1441596863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-43f5dd56-28db-4ac9-a860-c7ed52132b68" returned: 0 in 0.493s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-84f1f1fe-7de8-4ee5-ae46-df41d7c303b7 tempest-AttachVolumeTestJSON-1441596863 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-43f5dd56-28db-4ac9-a860-c7ed52132b68 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-84f1f1fe-7de8-4ee5-ae46-df41d7c303b7 tempest-AttachVolumeTestJSON-1441596863 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-43f5dd56-28db-4ac9-a860-c7ed52132b68" returned: 0 in 0.106s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:28 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-84f1f1fe-7de8-4ee5-ae46-df41d7c303b7 tempest-AttachVolumeTestJSON-1441596863 None] Lock "cinder-quobyte-43f5dd56-28db-4ac9-a860-c7ed52132b68" released by "delete_volume" :: held 0.773s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.514s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-84f1f1fe-7de8-4ee5-ae46-df41d7c303b7 tempest-AttachVolumeTestJSON-1441596863 None] Created reservations ['c7324ca4-ad27-41b1-90b8-dd4a703e18f0', '3f2c87fc-55f4-4ba3-9758-a58c69c4599c', '88b25db3-e058-4afa-ae39-951b088bf743', '38f3fb2b-d6fa-40f1-a1e3-1b3a81d385db'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:30:29 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Flow 'volume_create_manager' (f48fc71e-aa94-4b77-a521-c671ee14b83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8b8f01-8854-4bb0-ae5b-b80def4e05d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8b8f01-8854-4bb0-ae5b-b80def4e05d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1111620204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e752e33d-1c9a-4de0-880b-4b72cff4d12c,host='devstack@QuobyteHD#QuobyteHD',id=1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90d78fb80fca4cb4b7eed18607551ae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:30:29Z,use_quota=True,user_id='61184f76f06c408982d044bb6dc422b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08a95647-6c64-488c-8743-929a9327fbbb),volume_type_id=08a95647-6c64-488c-8743-929a9327fbbb)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d2e950e-8857-4748-823a-a27874dd95e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d2e950e-8857-4748-823a-a27874dd95e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0cca5dc-4057-45e2-8e1e-90ee3e377e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0cca5dc-4057-45e2-8e1e-90ee3e377e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919', 'volume_name': 'volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffea4927-b69b-432a-b433-9b0a6fc40d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffea4927-b69b-432a-b433-9b0a6fc40d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e14436-7989-4ee2-8c5a-234c7c1ac4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:30:29 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Volume 1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919', 'volume_size': 1} Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e752e33d-1c9a-4de0-880b-4b72cff4d12c,created_at=2025-09-10T13:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1111620204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e752e33d-1c9a-4de0-880b-4b72cff4d12c,host='devstack@QuobyteHD#QuobyteHD',id=1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90d78fb80fca4cb4b7eed18607551ae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:30:29Z,use_quota=True,user_id='61184f76f06c408982d044bb6dc422b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08a95647-6c64-488c-8743-929a9327fbbb),volume_type_id=08a95647-6c64-488c-8743-929a9327fbbb)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Creating volume 1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:30:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:30:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:30:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:30:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:30:30 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:30:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-84f1f1fe-7de8-4ee5-ae46-df41d7c303b7 tempest-AttachVolumeTestJSON-1441596863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:30:30 devstack quobyte-client[82814]: System call of process 90961 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:30:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-84f1f1fe-7de8-4ee5-ae46-df41d7c303b7 tempest-AttachVolumeTestJSON-1441596863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.035s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:30:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-84f1f1fe-7de8-4ee5-ae46-df41d7c303b7 tempest-AttachVolumeTestJSON-1441596863 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:30:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-84f1f1fe-7de8-4ee5-ae46-df41d7c303b7 tempest-AttachVolumeTestJSON-1441596863 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:30:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-84f1f1fe-7de8-4ee5-ae46-df41d7c303b7 tempest-AttachVolumeTestJSON-1441596863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:30:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-84f1f1fe-7de8-4ee5-ae46-df41d7c303b7 tempest-AttachVolumeTestJSON-1441596863 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:30 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=21, name=volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:30:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-84f1f1fe-7de8-4ee5-ae46-df41d7c303b7 tempest-AttachVolumeTestJSON-1441596863 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.273s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:30 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-84f1f1fe-7de8-4ee5-ae46-df41d7c303b7 tempest-AttachVolumeTestJSON-1441596863 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:30:30 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-84f1f1fe-7de8-4ee5-ae46-df41d7c303b7 tempest-AttachVolumeTestJSON-1441596863 None] Deleted volume successfully. Sep 10 15:30:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919 1073741824" returned: 0 in 0.830s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:31 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-97a48110-5581-4f70-84b2-c532be7e3882 tempest-AttachVolumeTestJSON-1441596863 None] Acquiring lock "cinder-8c2af551-a248-47d5-aedf-1982c58c4210-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:30:31 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-84f1f1fe-7de8-4ee5-ae46-df41d7c303b7 tempest-AttachVolumeTestJSON-1441596863 None] Lock "cinder-43f5dd56-28db-4ac9-a860-c7ed52132b68-delete_volume" released by "delete_volume" :: held 3.739s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:30:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919" returned: 0 in 0.554s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:31 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-97a48110-5581-4f70-84b2-c532be7e3882 tempest-AttachVolumeTestJSON-1441596863 None] Lock "cinder-8c2af551-a248-47d5-aedf-1982c58c4210-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:30:31 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] <== create_volume: return (1451ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:30:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:30:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e14436-7989-4ee2-8c5a-234c7c1ac4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:30:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c0fabc-daad-4fbc-8b79-2f9cb96888b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:30:31 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-97a48110-5581-4f70-84b2-c532be7e3882 tempest-AttachVolumeTestJSON-1441596863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:30:31 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-97a48110-5581-4f70-84b2-c532be7e3882 tempest-AttachVolumeTestJSON-1441596863 None] Acquiring lock "cinder-quobyte-8c2af551-a248-47d5-aedf-1982c58c4210" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:30:31 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Volume volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919 (1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919): created successfully Sep 10 15:30:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c0fabc-daad-4fbc-8b79-2f9cb96888b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:30:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Flow 'volume_create_manager' (f48fc71e-aa94-4b77-a521-c671ee14b83d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:30:31 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-97a48110-5581-4f70-84b2-c532be7e3882 tempest-AttachVolumeTestJSON-1441596863 None] Lock "cinder-quobyte-8c2af551-a248-47d5-aedf-1982c58c4210" acquired by "delete_volume" :: waited 0.059s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:30:31 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-09372418-95bd-4f64-809b-cc7c44c888ba tempest-GroupSnapshotsTest-829329676 None] Created volume successfully. Sep 10 15:30:31 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac5306b-7a6f-46d2-a919-982c0ca19957]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:30:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-97a48110-5581-4f70-84b2-c532be7e3882 tempest-AttachVolumeTestJSON-1441596863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c2af551-a248-47d5-aedf-1982c58c4210 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-97a48110-5581-4f70-84b2-c532be7e3882 tempest-AttachVolumeTestJSON-1441596863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c2af551-a248-47d5-aedf-1982c58c4210" returned: 0 in 0.621s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-97a48110-5581-4f70-84b2-c532be7e3882 tempest-AttachVolumeTestJSON-1441596863 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c2af551-a248-47d5-aedf-1982c58c4210 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-97a48110-5581-4f70-84b2-c532be7e3882 tempest-AttachVolumeTestJSON-1441596863 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c2af551-a248-47d5-aedf-1982c58c4210" returned: 0 in 0.472s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:33 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-97a48110-5581-4f70-84b2-c532be7e3882 tempest-AttachVolumeTestJSON-1441596863 None] Lock "cinder-quobyte-8c2af551-a248-47d5-aedf-1982c58c4210" released by "delete_volume" :: held 1.581s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:30:33 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-97a48110-5581-4f70-84b2-c532be7e3882 tempest-AttachVolumeTestJSON-1441596863 None] Created reservations ['57b932f7-b0a6-43e9-9e61-88791542a7c4', '3ffdee5c-4d29-4a2f-b9d0-16f6946adafa', '799388d3-9beb-4098-8da3-eeeebd312ac8', 'd52ef29a-e983-4d37-adcf-c34a5b8d03e8'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:30:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-97a48110-5581-4f70-84b2-c532be7e3882 tempest-AttachVolumeTestJSON-1441596863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:30:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-97a48110-5581-4f70-84b2-c532be7e3882 tempest-AttachVolumeTestJSON-1441596863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:30:34 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-97a48110-5581-4f70-84b2-c532be7e3882 tempest-AttachVolumeTestJSON-1441596863 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:30:34 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-97a48110-5581-4f70-84b2-c532be7e3882 tempest-AttachVolumeTestJSON-1441596863 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:30:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-97a48110-5581-4f70-84b2-c532be7e3882 tempest-AttachVolumeTestJSON-1441596863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:30:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-97a48110-5581-4f70-84b2-c532be7e3882 tempest-AttachVolumeTestJSON-1441596863 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-97a48110-5581-4f70-84b2-c532be7e3882 tempest-AttachVolumeTestJSON-1441596863 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.193s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:34 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-97a48110-5581-4f70-84b2-c532be7e3882 tempest-AttachVolumeTestJSON-1441596863 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:30:36 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-97a48110-5581-4f70-84b2-c532be7e3882 tempest-AttachVolumeTestJSON-1441596863 None] Deleted volume successfully. Sep 10 15:30:36 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:30:36 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:30:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Flow 'volume_create_manager' (d98b2ef1-0008-4690-af57-d4cf49c08030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:30:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5099815f-83db-49a4-a2b3-fd0a1c7bbae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:30:37 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-97a48110-5581-4f70-84b2-c532be7e3882 tempest-AttachVolumeTestJSON-1441596863 None] Lock "cinder-8c2af551-a248-47d5-aedf-1982c58c4210-delete_volume" released by "delete_volume" :: held 5.652s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:30:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5099815f-83db-49a4-a2b3-fd0a1c7bbae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-83422616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e752e33d-1c9a-4de0-880b-4b72cff4d12c,host='devstack@QuobyteHD#QuobyteHD',id=81518e17-2ae9-47c9-a840-5974760c18a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90d78fb80fca4cb4b7eed18607551ae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:30:35Z,use_quota=True,user_id='61184f76f06c408982d044bb6dc422b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08a95647-6c64-488c-8743-929a9327fbbb),volume_type_id=08a95647-6c64-488c-8743-929a9327fbbb)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:30:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c070e32-dbdb-45c1-a9f1-e0db81998efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:30:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c070e32-dbdb-45c1-a9f1-e0db81998efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:30:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79120712-a8bf-4788-8349-764bbe0affe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:30:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79120712-a8bf-4788-8349-764bbe0affe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81518e17-2ae9-47c9-a840-5974760c18a9', 'volume_name': 'volume-81518e17-2ae9-47c9-a840-5974760c18a9', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:30:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (574028f4-23b0-472e-9727-ca1bda92e634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:30:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (574028f4-23b0-472e-9727-ca1bda92e634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:30:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cfa688b-b1d2-42a5-b60e-f59f25942b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:30:37 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Volume 81518e17-2ae9-47c9-a840-5974760c18a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81518e17-2ae9-47c9-a840-5974760c18a9', 'volume_size': 1} Sep 10 15:30:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:30:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:30:37 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e752e33d-1c9a-4de0-880b-4b72cff4d12c,created_at=2025-09-10T13:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-83422616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e752e33d-1c9a-4de0-880b-4b72cff4d12c,host='devstack@QuobyteHD#QuobyteHD',id=81518e17-2ae9-47c9-a840-5974760c18a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90d78fb80fca4cb4b7eed18607551ae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:30:35Z,use_quota=True,user_id='61184f76f06c408982d044bb6dc422b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08a95647-6c64-488c-8743-929a9327fbbb),volume_type_id=08a95647-6c64-488c-8743-929a9327fbbb)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:30:37 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Creating volume 81518e17-2ae9-47c9-a840-5974760c18a9 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:30:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:30:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:30:37 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:30:37 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:30:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:30:37 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:30:37 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:30:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:37 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=22, name=volume-81518e17-2ae9-47c9-a840-5974760c18a9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:30:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9 1073741824" returned: 0 in 0.638s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9" returned: 0 in 0.146s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:38 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] <== create_volume: return (977ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:30:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:30:39 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cfa688b-b1d2-42a5-b60e-f59f25942b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81518e17-2ae9-47c9-a840-5974760c18a9', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:30:39 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad21eb99-7d88-477c-a266-b1c67c1ede53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:30:39 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Volume volume-81518e17-2ae9-47c9-a840-5974760c18a9 (81518e17-2ae9-47c9-a840-5974760c18a9): created successfully Sep 10 15:30:39 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad21eb99-7d88-477c-a266-b1c67c1ede53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:30:39 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Flow 'volume_create_manager' (d98b2ef1-0008-4690-af57-d4cf49c08030) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:30:39 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-22fea295-a4be-47c2-9fbf-d99e4368eae5 tempest-GroupSnapshotsTest-829329676 None] Created volume successfully. Sep 10 15:30:40 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-a1d43f5f-8692-4f5c-9487-83bf4b937912 tempest-GroupSnapshotsTest-829329676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:30:41 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-a1d43f5f-8692-4f5c-9487-83bf4b937912 tempest-GroupSnapshotsTest-829329676 None] Update group completed successfully. Sep 10 15:30:41 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-b9efe98e-0729-4870-8b93-5134108d8ebd tempest-GroupSnapshotsTest-829329676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:30:42 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-b9efe98e-0729-4870-8b93-5134108d8ebd tempest-GroupSnapshotsTest-829329676 None] Update group completed successfully. Sep 10 15:30:43 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-a7242fcd-ab90-4ffd-98e9-0ea958e197ce tempest-GroupSnapshotsTest-829329676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:30:43 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-a7242fcd-ab90-4ffd-98e9-0ea958e197ce tempest-GroupSnapshotsTest-829329676 None] Update group completed successfully. Sep 10 15:30:44 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-1c5f9de7-d6aa-48aa-8199-e037b1dd4def tempest-GroupSnapshotsTest-829329676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:30:44 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-1c5f9de7-d6aa-48aa-8199-e037b1dd4def tempest-GroupSnapshotsTest-829329676 None] Update group completed successfully. Sep 10 15:30:46 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] GroupSnapshot 32b7325a-2035-4700-83ee-8cf1cd5db53c: creating. Sep 10 15:30:46 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:30:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] Group snapshot 32b7325a-2035-4700-83ee-8cf1cd5db53c: creating. {{(pid=82800) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 10 15:30:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:30:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:30:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] Creating offline snapshot c10a76b0-c0ed-45f1-a957-4844497a5958 of volume 81518e17-2ae9-47c9-a840-5974760c18a9 {{(pid=82800) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 15:30:46 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb19f2d-4b4e-498f-84fa-31b8e6e5b95f]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:30:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:47 devstack quobyte-client[82814]: System call of process 91054 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:30:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9" returned: 0 in 0.653s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9.c10a76b0-c0ed-45f1-a957-4844497a5958 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:47 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=23, name=volume-81518e17-2ae9-47c9-a840-5974760c18a9.c10a76b0-c0ed-45f1-a957-4844497a5958, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:30:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9.c10a76b0-c0ed-45f1-a957-4844497a5958 1G" returned: 0 in 0.337s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): qemu-img rebase -u -b volume-81518e17-2ae9-47c9-a840-5974760c18a9 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9.c10a76b0-c0ed-45f1-a957-4844497a5958 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] CMD "qemu-img rebase -u -b volume-81518e17-2ae9-47c9-a840-5974760c18a9 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9.c10a76b0-c0ed-45f1-a957-4844497a5958" returned: 0 in 0.180s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:48 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9.c10a76b0-c0ed-45f1-a957-4844497a5958 is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:30:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9.c10a76b0-c0ed-45f1-a957-4844497a5958 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9.c10a76b0-c0ed-45f1-a957-4844497a5958" returned: 0 in 0.113s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:48 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] Setting permissions: /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9 -> 1000:1000 {{(pid=82800) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 15:30:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9.c10a76b0-c0ed-45f1-a957-4844497a5958 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9.c10a76b0-c0ed-45f1-a957-4844497a5958" returned: 0 in 0.121s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9.info" returned: 0 in 0.250s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:48 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9.info is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:30:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9.info" returned: 0 in 0.182s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.242s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:30:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:30:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:30:49 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] Creating offline snapshot edf98ef6-eff3-4260-87fc-99650a27e79b of volume 1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919 {{(pid=82800) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 15:30:49 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca8265c-1162-469b-851d-0458ee5a0873]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:30:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:49 devstack quobyte-client[82814]: System call of process 91069 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:30:49 devstack quobyte-client[82814]: System call of process 91069 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:30:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919" returned: 0 in 0.822s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919.edf98ef6-eff3-4260-87fc-99650a27e79b 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:50 devstack quobyte-client[82814]: System call of process 91073 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:30:50 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:30:50 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=25, name=volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919.edf98ef6-eff3-4260-87fc-99650a27e79b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:30:50 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:30:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Flow 'volume_create_manager' (93706d05-b7d2-407c-93b1-0482f24d441d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:30:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b620f0-4280-4108-89e7-15b8b62c8c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:30:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b620f0-4280-4108-89e7-15b8b62c8c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-327529101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b990964-53d9-4063-9a46-3314e6c2a036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5984d8f39a4491b8be494549f821064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:30:50Z,use_quota=True,user_id='67716dba4e264d2c8dbde758256d2c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:30:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4614214c-f685-4ace-988d-fa7157a19716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:30:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4614214c-f685-4ace-988d-fa7157a19716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:30:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713e0e26-c9d7-44bb-a4bd-b28a5f87b9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:30:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713e0e26-c9d7-44bb-a4bd-b28a5f87b9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b990964-53d9-4063-9a46-3314e6c2a036', 'volume_name': 'volume-4b990964-53d9-4063-9a46-3314e6c2a036', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:30:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (034a76dd-ff2f-4288-91b0-915f5c734ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:30:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (034a76dd-ff2f-4288-91b0-915f5c734ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:30:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211a541b-85df-4c35-8194-07f6d2afbea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:30:50 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Volume 4b990964-53d9-4063-9a46-3314e6c2a036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b990964-53d9-4063-9a46-3314e6c2a036', 'volume_size': 1} Sep 10 15:30:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:30:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919.edf98ef6-eff3-4260-87fc-99650a27e79b 1G" returned: 0 in 0.546s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): qemu-img rebase -u -b volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919.edf98ef6-eff3-4260-87fc-99650a27e79b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:51 devstack quobyte-client[82814]: System call of process 91076 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:30:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] CMD "qemu-img rebase -u -b volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919.edf98ef6-eff3-4260-87fc-99650a27e79b" returned: 0 in 0.304s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:51 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919.edf98ef6-eff3-4260-87fc-99650a27e79b is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:30:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919.edf98ef6-eff3-4260-87fc-99650a27e79b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919.edf98ef6-eff3-4260-87fc-99650a27e79b" returned: 0 in 0.110s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:51 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] Setting permissions: /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919 -> 1000:1000 {{(pid=82800) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 15:30:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919.edf98ef6-eff3-4260-87fc-99650a27e79b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919.edf98ef6-eff3-4260-87fc-99650a27e79b" returned: 0 in 0.161s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919.info" returned: 0 in 0.126s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:51 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919.info is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:30:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919.info" returned: 0 in 0.105s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.678s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:30:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.268s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:30:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-327529101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b990964-53d9-4063-9a46-3314e6c2a036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5984d8f39a4491b8be494549f821064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:30:50Z,use_quota=True,user_id='67716dba4e264d2c8dbde758256d2c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:30:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Creating volume 4b990964-53d9-4063-9a46-3314e6c2a036 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:30:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:30:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:30:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:30:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:30:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:30:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:30:52 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:30:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:52 devstack quobyte-client[82814]: System call of process 91083 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:30:52 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=27, name=volume-4b990964-53d9-4063-9a46-3314e6c2a036, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:30:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036 1073741824" returned: 0 in 0.664s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036" returned: 0 in 0.359s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] <== create_volume: return (1094ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:30:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:30:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211a541b-85df-4c35-8194-07f6d2afbea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b990964-53d9-4063-9a46-3314e6c2a036', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:30:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f89c49ce-f706-47ef-8b2e-dc4161d078f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:30:53 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Volume volume-4b990964-53d9-4063-9a46-3314e6c2a036 (4b990964-53d9-4063-9a46-3314e6c2a036): created successfully Sep 10 15:30:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f89c49ce-f706-47ef-8b2e-dc4161d078f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:30:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Flow 'volume_create_manager' (93706d05-b7d2-407c-93b1-0482f24d441d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:30:53 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-b9ea3e67-978e-46ec-8916-174f3b255715 req-e10c928f-2708-4fdf-892d-fc5399f8ddad tempest-VolumesSnapshotsTestJSON-559705315 None] Created volume successfully. Sep 10 15:30:53 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-8d16fd09-f605-4f0c-8782-6dd57ba2954e tempest-GroupSnapshotsTest-829329676 None] group_snapshot 32b7325a-2035-4700-83ee-8cf1cd5db53c: created successfully Sep 10 15:30:53 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] group_snapshot 32b7325a-2035-4700-83ee-8cf1cd5db53c: deleting Sep 10 15:30:54 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:30:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] group_snapshot 32b7325a-2035-4700-83ee-8cf1cd5db53c: deleting {{(pid=82800) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 10 15:30:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "cinder-quobyte-81518e17-2ae9-47c9-a840-5974760c18a9" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:30:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-81518e17-2ae9-47c9-a840-5974760c18a9" acquired by "delete_snapshot" :: waited 0.105s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:30:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "cinder-quobyte-c10a76b0-c0ed-45f1-a957-4844497a5958" by "_delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:30:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-c10a76b0-c0ed-45f1-a957-4844497a5958" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:30:54 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Deleting offline snapshot c10a76b0-c0ed-45f1-a957-4844497a5958 of volume 81518e17-2ae9-47c9-a840-5974760c18a9 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 15:30:54 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] snapshot_file for this snap is: volume-81518e17-2ae9-47c9-a840-5974760c18a9.c10a76b0-c0ed-45f1-a957-4844497a5958 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 15:30:54 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[730fcce0-8c7d-412e-9542-a98313508c5a]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:30:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9.c10a76b0-c0ed-45f1-a957-4844497a5958 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:55 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-5988e06a-eeec-4fc4-9dbd-3db984a5693c req-515c4b65-32e1-438e-8ddb-20b52507b781 tempest-VolumesSnapshotsTestJSON-559705315 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:30:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-5988e06a-eeec-4fc4-9dbd-3db984a5693c req-515c4b65-32e1-438e-8ddb-20b52507b781 tempest-VolumesSnapshotsTestJSON-559705315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:30:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-5988e06a-eeec-4fc4-9dbd-3db984a5693c req-515c4b65-32e1-438e-8ddb-20b52507b781 tempest-VolumesSnapshotsTestJSON-559705315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:30:55 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [req-5988e06a-eeec-4fc4-9dbd-3db984a5693c req-515c4b65-32e1-438e-8ddb-20b52507b781 tempest-VolumesSnapshotsTestJSON-559705315 None] Creating offline snapshot eae9fe74-1320-47f4-98a5-5fb08cf95544 of volume 4b990964-53d9-4063-9a46-3314e6c2a036 {{(pid=82800) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 15:30:55 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[738ac27d-6040-48aa-b25e-edb610113778]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:30:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-5988e06a-eeec-4fc4-9dbd-3db984a5693c req-515c4b65-32e1-438e-8ddb-20b52507b781 tempest-VolumesSnapshotsTestJSON-559705315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:55 devstack quobyte-client[82814]: System call of process 91089 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:30:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9.c10a76b0-c0ed-45f1-a957-4844497a5958" returned: 0 in 1.061s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:55 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81518e17-2ae9-47c9-a840-5974760c18a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:30:55 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2d830d-212d-41f3-ba43-9875b3de7e2e]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:30:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:56 devstack quobyte-client[82814]: System call of process 91091 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:30:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-5988e06a-eeec-4fc4-9dbd-3db984a5693c req-515c4b65-32e1-438e-8ddb-20b52507b781 tempest-VolumesSnapshotsTestJSON-559705315 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036" returned: 0 in 1.038s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-5988e06a-eeec-4fc4-9dbd-3db984a5693c req-515c4b65-32e1-438e-8ddb-20b52507b781 tempest-VolumesSnapshotsTestJSON-559705315 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036.eae9fe74-1320-47f4-98a5-5fb08cf95544 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:56 devstack quobyte-client[82814]: System call of process 91094 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:30:56 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=28, name=volume-4b990964-53d9-4063-9a46-3314e6c2a036.eae9fe74-1320-47f4-98a5-5fb08cf95544, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:30:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9" returned: 0 in 1.080s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9.c10a76b0-c0ed-45f1-a957-4844497a5958 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:57 devstack quobyte-client[82814]: System call of process 91105 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:30:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-5988e06a-eeec-4fc4-9dbd-3db984a5693c req-515c4b65-32e1-438e-8ddb-20b52507b781 tempest-VolumesSnapshotsTestJSON-559705315 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036.eae9fe74-1320-47f4-98a5-5fb08cf95544 1G" returned: 0 in 0.716s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-5988e06a-eeec-4fc4-9dbd-3db984a5693c req-515c4b65-32e1-438e-8ddb-20b52507b781 tempest-VolumesSnapshotsTestJSON-559705315 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4b990964-53d9-4063-9a46-3314e6c2a036 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036.eae9fe74-1320-47f4-98a5-5fb08cf95544 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9.c10a76b0-c0ed-45f1-a957-4844497a5958" returned: 0 in 0.439s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9.c10a76b0-c0ed-45f1-a957-4844497a5958 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:57 devstack quobyte-client[82814]: System call of process 91110 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:30:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-5988e06a-eeec-4fc4-9dbd-3db984a5693c req-515c4b65-32e1-438e-8ddb-20b52507b781 tempest-VolumesSnapshotsTestJSON-559705315 None] CMD "qemu-img rebase -u -b volume-4b990964-53d9-4063-9a46-3314e6c2a036 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036.eae9fe74-1320-47f4-98a5-5fb08cf95544" returned: 0 in 0.430s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:57 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [req-5988e06a-eeec-4fc4-9dbd-3db984a5693c req-515c4b65-32e1-438e-8ddb-20b52507b781 tempest-VolumesSnapshotsTestJSON-559705315 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036.eae9fe74-1320-47f4-98a5-5fb08cf95544 is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:30:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-5988e06a-eeec-4fc4-9dbd-3db984a5693c req-515c4b65-32e1-438e-8ddb-20b52507b781 tempest-VolumesSnapshotsTestJSON-559705315 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036.eae9fe74-1320-47f4-98a5-5fb08cf95544 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9.c10a76b0-c0ed-45f1-a957-4844497a5958" returned: 0 in 0.339s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:58 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-c10a76b0-c0ed-45f1-a957-4844497a5958" released by "_delete_snapshot" :: held 3.957s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:30:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-5988e06a-eeec-4fc4-9dbd-3db984a5693c req-515c4b65-32e1-438e-8ddb-20b52507b781 tempest-VolumesSnapshotsTestJSON-559705315 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036.eae9fe74-1320-47f4-98a5-5fb08cf95544" returned: 0 in 0.704s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [req-5988e06a-eeec-4fc4-9dbd-3db984a5693c req-515c4b65-32e1-438e-8ddb-20b52507b781 tempest-VolumesSnapshotsTestJSON-559705315 None] Setting permissions: /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036 -> 1000:1000 {{(pid=82800) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 15:30:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-5988e06a-eeec-4fc4-9dbd-3db984a5693c req-515c4b65-32e1-438e-8ddb-20b52507b781 tempest-VolumesSnapshotsTestJSON-559705315 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036.eae9fe74-1320-47f4-98a5-5fb08cf95544 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:58 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-81518e17-2ae9-47c9-a840-5974760c18a9" released by "delete_snapshot" :: held 4.332s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:30:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-5988e06a-eeec-4fc4-9dbd-3db984a5693c req-515c4b65-32e1-438e-8ddb-20b52507b781 tempest-VolumesSnapshotsTestJSON-559705315 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036.eae9fe74-1320-47f4-98a5-5fb08cf95544" returned: 0 in 0.684s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-5988e06a-eeec-4fc4-9dbd-3db984a5693c req-515c4b65-32e1-438e-8ddb-20b52507b781 tempest-VolumesSnapshotsTestJSON-559705315 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:59 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "cinder-quobyte-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:30:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-5988e06a-eeec-4fc4-9dbd-3db984a5693c req-515c4b65-32e1-438e-8ddb-20b52507b781 tempest-VolumesSnapshotsTestJSON-559705315 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036.info" returned: 0 in 0.481s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:59 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919" acquired by "delete_snapshot" :: waited 0.154s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:30:59 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "cinder-quobyte-edf98ef6-eff3-4260-87fc-99650a27e79b" by "_delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:30:59 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [req-5988e06a-eeec-4fc4-9dbd-3db984a5693c req-515c4b65-32e1-438e-8ddb-20b52507b781 tempest-VolumesSnapshotsTestJSON-559705315 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036.info is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:30:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-5988e06a-eeec-4fc4-9dbd-3db984a5693c req-515c4b65-32e1-438e-8ddb-20b52507b781 tempest-VolumesSnapshotsTestJSON-559705315 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:30:59 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-edf98ef6-eff3-4260-87fc-99650a27e79b" acquired by "_delete_snapshot" :: waited 0.155s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:30:59 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Deleting offline snapshot edf98ef6-eff3-4260-87fc-99650a27e79b of volume 1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 15:30:59 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] snapshot_file for this snap is: volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919.edf98ef6-eff3-4260-87fc-99650a27e79b {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 15:30:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-5988e06a-eeec-4fc4-9dbd-3db984a5693c req-515c4b65-32e1-438e-8ddb-20b52507b781 tempest-VolumesSnapshotsTestJSON-559705315 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036.info" returned: 0 in 0.194s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:30:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-5988e06a-eeec-4fc4-9dbd-3db984a5693c req-515c4b65-32e1-438e-8ddb-20b52507b781 tempest-VolumesSnapshotsTestJSON-559705315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.769s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:30:59 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be096ee-9aaa-4431-90c0-1bf72b0bf84f]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:31:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919.edf98ef6-eff3-4260-87fc-99650a27e79b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:00 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-5988e06a-eeec-4fc4-9dbd-3db984a5693c req-515c4b65-32e1-438e-8ddb-20b52507b781 tempest-VolumesSnapshotsTestJSON-559705315 None] Create snapshot completed successfully Sep 10 15:31:00 devstack cinder-volume[82800]: DEBUG cinder.coordination [req-c0b7a787-4933-425c-b758-6f76f8ef1926 req-dfefdf40-69e8-4799-9496-249354c7a99e tempest-VolumesSnapshotsTestJSON-559705315 None] Acquiring lock "cinder-eae9fe74-1320-47f4-98a5-5fb08cf95544-delete_snapshot" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:31:00 devstack cinder-volume[82800]: DEBUG cinder.coordination [req-c0b7a787-4933-425c-b758-6f76f8ef1926 req-dfefdf40-69e8-4799-9496-249354c7a99e tempest-VolumesSnapshotsTestJSON-559705315 None] Lock "cinder-eae9fe74-1320-47f4-98a5-5fb08cf95544-delete_snapshot" acquired by "delete_snapshot" :: waited 0.077s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:31:00 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-c0b7a787-4933-425c-b758-6f76f8ef1926 req-dfefdf40-69e8-4799-9496-249354c7a99e tempest-VolumesSnapshotsTestJSON-559705315 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:31:00 devstack cinder-volume[82800]: DEBUG cinder.coordination [req-c0b7a787-4933-425c-b758-6f76f8ef1926 req-dfefdf40-69e8-4799-9496-249354c7a99e tempest-VolumesSnapshotsTestJSON-559705315 None] Acquiring lock "cinder-quobyte-4b990964-53d9-4063-9a46-3314e6c2a036" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:31:00 devstack cinder-volume[82800]: DEBUG cinder.coordination [req-c0b7a787-4933-425c-b758-6f76f8ef1926 req-dfefdf40-69e8-4799-9496-249354c7a99e tempest-VolumesSnapshotsTestJSON-559705315 None] Lock "cinder-quobyte-4b990964-53d9-4063-9a46-3314e6c2a036" acquired by "delete_snapshot" :: waited 0.037s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:31:00 devstack cinder-volume[82800]: DEBUG cinder.coordination [req-c0b7a787-4933-425c-b758-6f76f8ef1926 req-dfefdf40-69e8-4799-9496-249354c7a99e tempest-VolumesSnapshotsTestJSON-559705315 None] Acquiring lock "cinder-quobyte-eae9fe74-1320-47f4-98a5-5fb08cf95544" by "_delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:31:00 devstack cinder-volume[82800]: DEBUG cinder.coordination [req-c0b7a787-4933-425c-b758-6f76f8ef1926 req-dfefdf40-69e8-4799-9496-249354c7a99e tempest-VolumesSnapshotsTestJSON-559705315 None] Lock "cinder-quobyte-eae9fe74-1320-47f4-98a5-5fb08cf95544" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:31:01 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [req-c0b7a787-4933-425c-b758-6f76f8ef1926 req-dfefdf40-69e8-4799-9496-249354c7a99e tempest-VolumesSnapshotsTestJSON-559705315 None] Deleting offline snapshot eae9fe74-1320-47f4-98a5-5fb08cf95544 of volume 4b990964-53d9-4063-9a46-3314e6c2a036 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 15:31:01 devstack quobyte-client[82814]: System call of process 91119 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:31:01 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [req-c0b7a787-4933-425c-b758-6f76f8ef1926 req-dfefdf40-69e8-4799-9496-249354c7a99e tempest-VolumesSnapshotsTestJSON-559705315 None] snapshot_file for this snap is: volume-4b990964-53d9-4063-9a46-3314e6c2a036.eae9fe74-1320-47f4-98a5-5fb08cf95544 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 15:31:01 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c06a75f-9c36-48b8-823f-e43efcabdc11]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:31:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-c0b7a787-4933-425c-b758-6f76f8ef1926 req-dfefdf40-69e8-4799-9496-249354c7a99e tempest-VolumesSnapshotsTestJSON-559705315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036.eae9fe74-1320-47f4-98a5-5fb08cf95544 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919.edf98ef6-eff3-4260-87fc-99650a27e79b" returned: 0 in 1.263s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:01 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:31:01 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[8639aa81-0865-4f58-a093-8480594c4cd7]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:31:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-c0b7a787-4933-425c-b758-6f76f8ef1926 req-dfefdf40-69e8-4799-9496-249354c7a99e tempest-VolumesSnapshotsTestJSON-559705315 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036.eae9fe74-1320-47f4-98a5-5fb08cf95544" returned: 0 in 0.826s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:02 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [req-c0b7a787-4933-425c-b758-6f76f8ef1926 req-dfefdf40-69e8-4799-9496-249354c7a99e tempest-VolumesSnapshotsTestJSON-559705315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b990964-53d9-4063-9a46-3314e6c2a036(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:31:02 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[907a61d8-e9eb-4f08-beab-dc20e1d92bde]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:31:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-c0b7a787-4933-425c-b758-6f76f8ef1926 req-dfefdf40-69e8-4799-9496-249354c7a99e tempest-VolumesSnapshotsTestJSON-559705315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919" returned: 0 in 0.835s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919.edf98ef6-eff3-4260-87fc-99650a27e79b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:02 devstack quobyte-client[82814]: System call of process 91130 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:31:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-c0b7a787-4933-425c-b758-6f76f8ef1926 req-dfefdf40-69e8-4799-9496-249354c7a99e tempest-VolumesSnapshotsTestJSON-559705315 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036" returned: 0 in 0.677s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-c0b7a787-4933-425c-b758-6f76f8ef1926 req-dfefdf40-69e8-4799-9496-249354c7a99e tempest-VolumesSnapshotsTestJSON-559705315 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036.eae9fe74-1320-47f4-98a5-5fb08cf95544 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919.edf98ef6-eff3-4260-87fc-99650a27e79b" returned: 0 in 0.531s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919.edf98ef6-eff3-4260-87fc-99650a27e79b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919.edf98ef6-eff3-4260-87fc-99650a27e79b" returned: 0 in 0.165s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:03 devstack quobyte-client[82814]: System call of process 91135 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:31:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-edf98ef6-eff3-4260-87fc-99650a27e79b" released by "_delete_snapshot" :: held 3.523s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:31:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919" released by "delete_snapshot" :: held 3.736s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:31:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-c0b7a787-4933-425c-b758-6f76f8ef1926 req-dfefdf40-69e8-4799-9496-249354c7a99e tempest-VolumesSnapshotsTestJSON-559705315 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036.eae9fe74-1320-47f4-98a5-5fb08cf95544" returned: 0 in 0.628s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-c0b7a787-4933-425c-b758-6f76f8ef1926 req-dfefdf40-69e8-4799-9496-249354c7a99e tempest-VolumesSnapshotsTestJSON-559705315 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036.eae9fe74-1320-47f4-98a5-5fb08cf95544 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-c0b7a787-4933-425c-b758-6f76f8ef1926 req-dfefdf40-69e8-4799-9496-249354c7a99e tempest-VolumesSnapshotsTestJSON-559705315 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036.eae9fe74-1320-47f4-98a5-5fb08cf95544" returned: 0 in 0.260s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [req-c0b7a787-4933-425c-b758-6f76f8ef1926 req-dfefdf40-69e8-4799-9496-249354c7a99e tempest-VolumesSnapshotsTestJSON-559705315 None] Lock "cinder-quobyte-eae9fe74-1320-47f4-98a5-5fb08cf95544" released by "_delete_snapshot" :: held 2.954s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:31:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [req-c0b7a787-4933-425c-b758-6f76f8ef1926 req-dfefdf40-69e8-4799-9496-249354c7a99e tempest-VolumesSnapshotsTestJSON-559705315 None] Lock "cinder-quobyte-4b990964-53d9-4063-9a46-3314e6c2a036" released by "delete_snapshot" :: held 3.030s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:31:04 devstack cinder-volume[82800]: WARNING cinder.quota [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1348026892 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1348026892, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:31:04 devstack cinder-volume[82800]: WARNING cinder.quota [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1348026892 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1348026892, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:31:04 devstack cinder-volume[82800]: WARNING cinder.quota [req-c0b7a787-4933-425c-b758-6f76f8ef1926 req-dfefdf40-69e8-4799-9496-249354c7a99e tempest-VolumesSnapshotsTestJSON-559705315 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:31:04 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Created reservations ['2e95c23b-8f21-412d-8f78-220b44a2b743', '8ecc3364-bf88-4b16-856a-d371db9d58bf', 'e770ea43-4a57-4294-8fb8-2ec6d5aebbdd', '7d4c6537-0f63-4a52-a6a9-6906303cba05'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:31:04 devstack cinder-volume[82800]: DEBUG cinder.quota [req-c0b7a787-4933-425c-b758-6f76f8ef1926 req-dfefdf40-69e8-4799-9496-249354c7a99e tempest-VolumesSnapshotsTestJSON-559705315 None] Created reservations ['20bba9e3-71b0-4363-bd90-9f22bad589dd', '379a3784-fac8-48b7-b50c-48e1ef969263', 'd79eb21d-37d7-4237-b925-c3eb23900d6d', 'acb73f20-0a41-45e7-8dc0-f633b6ef356a'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:31:04 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-c0b7a787-4933-425c-b758-6f76f8ef1926 req-dfefdf40-69e8-4799-9496-249354c7a99e tempest-VolumesSnapshotsTestJSON-559705315 None] Delete snapshot completed successfully. Sep 10 15:31:04 devstack cinder-volume[82800]: DEBUG cinder.coordination [req-c0b7a787-4933-425c-b758-6f76f8ef1926 req-dfefdf40-69e8-4799-9496-249354c7a99e tempest-VolumesSnapshotsTestJSON-559705315 None] Lock "cinder-eae9fe74-1320-47f4-98a5-5fb08cf95544-delete_snapshot" released by "delete_snapshot" :: held 3.427s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:31:04 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] Created reservations ['9a777a24-7fc2-40e9-b973-2479333ed6fd', '20203525-0cf1-4a7f-be15-2124d3e7fdba', 'a3de7688-2f07-4087-988f-7da7d53288bd', 'd8adadfa-b7c6-4029-ab13-13b6499aba27'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:31:04 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-9deacd84-2bce-4fcd-a573-b4c1ff960187 tempest-GroupSnapshotsTest-829329676 None] group_snapshot 32b7325a-2035-4700-83ee-8cf1cd5db53c: deleted successfully Sep 10 15:31:05 devstack cinder-volume[82800]: DEBUG cinder.coordination [req-9065f51a-1e32-45ab-a458-273e6eb04fa7 req-bd76fe9e-4250-4c76-9cee-2d4d2c44668d tempest-VolumesSnapshotsTestJSON-559705315 None] Acquiring lock "cinder-4b990964-53d9-4063-9a46-3314e6c2a036-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:31:05 devstack cinder-volume[82800]: DEBUG cinder.coordination [req-9065f51a-1e32-45ab-a458-273e6eb04fa7 req-bd76fe9e-4250-4c76-9cee-2d4d2c44668d tempest-VolumesSnapshotsTestJSON-559705315 None] Lock "cinder-4b990964-53d9-4063-9a46-3314e6c2a036-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:31:05 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=95,cinder:SELECT=97,cinder:INSERT=25,cinder:DELETE=2 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:31:05 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=77,cinder:SELECT=63,cinder:INSERT=13,cinder:DELETE=5 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:31:05 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-9065f51a-1e32-45ab-a458-273e6eb04fa7 req-bd76fe9e-4250-4c76-9cee-2d4d2c44668d tempest-VolumesSnapshotsTestJSON-559705315 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:31:05 devstack cinder-volume[82800]: DEBUG cinder.coordination [req-9065f51a-1e32-45ab-a458-273e6eb04fa7 req-bd76fe9e-4250-4c76-9cee-2d4d2c44668d tempest-VolumesSnapshotsTestJSON-559705315 None] Acquiring lock "cinder-quobyte-4b990964-53d9-4063-9a46-3314e6c2a036" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:31:05 devstack cinder-volume[82800]: DEBUG cinder.coordination [req-9065f51a-1e32-45ab-a458-273e6eb04fa7 req-bd76fe9e-4250-4c76-9cee-2d4d2c44668d tempest-VolumesSnapshotsTestJSON-559705315 None] Lock "cinder-quobyte-4b990964-53d9-4063-9a46-3314e6c2a036" acquired by "delete_volume" :: waited 0.026s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:31:05 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[046e8a25-36c9-41a0-9c55-68e0ec59ab14]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:31:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-9065f51a-1e32-45ab-a458-273e6eb04fa7 req-bd76fe9e-4250-4c76-9cee-2d4d2c44668d tempest-VolumesSnapshotsTestJSON-559705315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:06 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:31:06 devstack quobyte-client[82814]: System call of process 91143 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:31:06 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "cinder-quobyte-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:31:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-9065f51a-1e32-45ab-a458-273e6eb04fa7 req-bd76fe9e-4250-4c76-9cee-2d4d2c44668d tempest-VolumesSnapshotsTestJSON-559705315 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036" returned: 0 in 0.857s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-9065f51a-1e32-45ab-a458-273e6eb04fa7 req-bd76fe9e-4250-4c76-9cee-2d4d2c44668d tempest-VolumesSnapshotsTestJSON-559705315 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:06 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919" acquired by "delete_volume" :: waited 0.235s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:31:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-9065f51a-1e32-45ab-a458-273e6eb04fa7 req-bd76fe9e-4250-4c76-9cee-2d4d2c44668d tempest-VolumesSnapshotsTestJSON-559705315 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b990964-53d9-4063-9a46-3314e6c2a036" returned: 0 in 0.295s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:06 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1115d3-161d-4eb4-b730-857f7180ba7a]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:31:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:07 devstack cinder-volume[82800]: DEBUG cinder.coordination [req-9065f51a-1e32-45ab-a458-273e6eb04fa7 req-bd76fe9e-4250-4c76-9cee-2d4d2c44668d tempest-VolumesSnapshotsTestJSON-559705315 None] Lock "cinder-quobyte-4b990964-53d9-4063-9a46-3314e6c2a036" released by "delete_volume" :: held 1.448s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:31:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919" returned: 0 in 0.642s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:07 devstack cinder-volume[82800]: DEBUG cinder.quota [req-9065f51a-1e32-45ab-a458-273e6eb04fa7 req-bd76fe9e-4250-4c76-9cee-2d4d2c44668d tempest-VolumesSnapshotsTestJSON-559705315 None] Created reservations ['9bf73d5d-e460-4a03-bd6b-c501801bdfa2', '9fa135ad-cf7f-49d8-981d-08cbef8e031b', 'bfaf6c66-535d-4874-af1b-186835de7a93', '5ec9f106-24aa-4633-a16a-1dbd69a8a8c8'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:31:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919" returned: 0 in 0.284s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:07 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-1d2a88b0-39a4-4f9c-9e0f-49dc9a4d9919" released by "delete_volume" :: held 1.190s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:31:08 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "cinder-quobyte-81518e17-2ae9-47c9-a840-5974760c18a9" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:31:08 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-81518e17-2ae9-47c9-a840-5974760c18a9" acquired by "delete_volume" :: waited 0.110s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:31:08 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f2bbcc-077a-4e20-8168-38e4b06ae529]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:31:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-9065f51a-1e32-45ab-a458-273e6eb04fa7 req-bd76fe9e-4250-4c76-9cee-2d4d2c44668d tempest-VolumesSnapshotsTestJSON-559705315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:31:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-9065f51a-1e32-45ab-a458-273e6eb04fa7 req-bd76fe9e-4250-4c76-9cee-2d4d2c44668d tempest-VolumesSnapshotsTestJSON-559705315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.090s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:31:08 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [req-9065f51a-1e32-45ab-a458-273e6eb04fa7 req-bd76fe9e-4250-4c76-9cee-2d4d2c44668d tempest-VolumesSnapshotsTestJSON-559705315 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:31:08 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [req-9065f51a-1e32-45ab-a458-273e6eb04fa7 req-bd76fe9e-4250-4c76-9cee-2d4d2c44668d tempest-VolumesSnapshotsTestJSON-559705315 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:31:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-9065f51a-1e32-45ab-a458-273e6eb04fa7 req-bd76fe9e-4250-4c76-9cee-2d4d2c44668d tempest-VolumesSnapshotsTestJSON-559705315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.083s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:31:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-9065f51a-1e32-45ab-a458-273e6eb04fa7 req-bd76fe9e-4250-4c76-9cee-2d4d2c44668d tempest-VolumesSnapshotsTestJSON-559705315 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:08 devstack quobyte-client[82814]: System call of process 91154 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:31:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9" returned: 0 in 0.942s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-9065f51a-1e32-45ab-a458-273e6eb04fa7 req-bd76fe9e-4250-4c76-9cee-2d4d2c44668d tempest-VolumesSnapshotsTestJSON-559705315 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.398s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:09 devstack cinder-volume[82800]: DEBUG cinder.manager [req-9065f51a-1e32-45ab-a458-273e6eb04fa7 req-bd76fe9e-4250-4c76-9cee-2d4d2c44668d tempest-VolumesSnapshotsTestJSON-559705315 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:31:09 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-9065f51a-1e32-45ab-a458-273e6eb04fa7 req-bd76fe9e-4250-4c76-9cee-2d4d2c44668d tempest-VolumesSnapshotsTestJSON-559705315 None] Deleted volume successfully. Sep 10 15:31:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-81518e17-2ae9-47c9-a840-5974760c18a9" returned: 0 in 0.475s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:09 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-81518e17-2ae9-47c9-a840-5974760c18a9" released by "delete_volume" :: held 1.648s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:31:10 devstack cinder-volume[82800]: DEBUG cinder.coordination [req-9065f51a-1e32-45ab-a458-273e6eb04fa7 req-bd76fe9e-4250-4c76-9cee-2d4d2c44668d tempest-VolumesSnapshotsTestJSON-559705315 None] Lock "cinder-4b990964-53d9-4063-9a46-3314e6c2a036-delete_volume" released by "delete_volume" :: held 4.531s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:31:10 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] Created reservations ['c9e64b4b-0cf2-4a08-be8b-e958fea782c6'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:31:10 devstack cinder-volume[82800]: WARNING cinder.quota [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1348026892 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1348026892, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:31:10 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] Created reservations ['23dd484f-a58f-4f0f-9197-879412ed8a56', 'c9a64281-f106-40f8-97b8-f03565858811', '8b9bb932-6669-45cd-b7da-012075b019ab', '77e67019-6a3b-4772-8ede-8becf701c379'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:31:11 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] Created reservations ['17354c18-6fac-4087-bd92-1c26c6f1bde7', '08078667-0127-4d16-8ec8-28ca1e55c14a', '02906a0b-ef7c-485b-9406-0daa917f4d8c', 'df3e348b-0787-4d06-aa85-fe36546ee93e'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:31:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:31:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:31:11 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:31:11 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:31:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:31:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.129s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:11 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:31:11 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-fd000e11-420d-4f2f-a9b4-6d0f602651de tempest-GroupSnapshotsTest-829329676 None] Delete group completed successfully. Sep 10 15:31:14 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-c8bfcd8d-488c-4581-a189-e14cfc23e496 tempest-GroupSnapshotsTest-829329676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:31:14 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-c8bfcd8d-488c-4581-a189-e14cfc23e496 tempest-GroupSnapshotsTest-829329676 None] Group tempest-GroupSnapshotsTest-Group-1707364392: creating Sep 10 15:31:14 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-c8bfcd8d-488c-4581-a189-e14cfc23e496 tempest-GroupSnapshotsTest-829329676 None] Group tempest-GroupSnapshotsTest-Group-1707364392: created successfully Sep 10 15:31:15 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-c8bfcd8d-488c-4581-a189-e14cfc23e496 tempest-GroupSnapshotsTest-829329676 None] Create group completed successfully. Sep 10 15:31:15 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:31:15 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:31:15 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Flow 'volume_create_manager' (949b725e-8064-4296-b898-b193381939a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:31:15 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d7fcc0a-92ee-4c99-a2c6-f7cab5876b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:15 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d7fcc0a-92ee-4c99-a2c6-f7cab5876b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1816039132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31389488-d4fb-4a89-8ca9-dc1facc09a69,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='84afa81712034c68a956ef90db7b815f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:31:15Z,use_quota=True,user_id='397bcd7a70ea4d4ba8d764de688cc474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:15 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b1fb31-e7b1-4ebc-8a65-8212ce12de9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:15 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b1fb31-e7b1-4ebc-8a65-8212ce12de9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:15 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aedb4931-fc2c-4163-a954-a2084b8b2b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:15 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aedb4931-fc2c-4163-a954-a2084b8b2b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31389488-d4fb-4a89-8ca9-dc1facc09a69', 'volume_name': 'volume-31389488-d4fb-4a89-8ca9-dc1facc09a69', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:15 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6463924b-988b-4e99-ad35-1b529a1b77aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:15 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6463924b-988b-4e99-ad35-1b529a1b77aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:15 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a6e779-7048-47d9-9b68-c35a53581ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:15 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Volume 31389488-d4fb-4a89-8ca9-dc1facc09a69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31389488-d4fb-4a89-8ca9-dc1facc09a69', 'volume_size': 1} Sep 10 15:31:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:31:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:31:15 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1816039132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31389488-d4fb-4a89-8ca9-dc1facc09a69,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='84afa81712034c68a956ef90db7b815f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:31:15Z,use_quota=True,user_id='397bcd7a70ea4d4ba8d764de688cc474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:31:15 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Creating volume 31389488-d4fb-4a89-8ca9-dc1facc09a69 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:31:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:31:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:31:15 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:31:15 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:31:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:31:15 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:31:15 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:31:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31389488-d4fb-4a89-8ca9-dc1facc09a69 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:16 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=30, name=volume-31389488-d4fb-4a89-8ca9-dc1facc09a69, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:31:16 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:31:16 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:31:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Flow 'volume_create_manager' (47ac7a43-bb63-4b47-a57d-891d321256a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:31:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb81608-cac9-477e-af4e-63f7647e55de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb81608-cac9-477e-af4e-63f7647e55de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-557376530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e3886c8d-b79d-4470-87fa-64b1157f9eef,host='devstack@QuobyteHD#QuobyteHD',id=3bde80b6-06dc-4d4a-9410-71ca98eba466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90d78fb80fca4cb4b7eed18607551ae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:31:16Z,use_quota=True,user_id='61184f76f06c408982d044bb6dc422b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801a7832-fdca-4900-b752-f68f6c6b5583),volume_type_id=801a7832-fdca-4900-b752-f68f6c6b5583)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34ab5750-f29d-4c70-84fd-d0bd9cc625bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34ab5750-f29d-4c70-84fd-d0bd9cc625bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51677fc4-f1f9-47a7-a69b-55b536219f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51677fc4-f1f9-47a7-a69b-55b536219f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bde80b6-06dc-4d4a-9410-71ca98eba466', 'volume_name': 'volume-3bde80b6-06dc-4d4a-9410-71ca98eba466', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e534e89-9c58-4665-87fc-8cc1dc91a386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e534e89-9c58-4665-87fc-8cc1dc91a386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ed2cc6-bfdf-479e-9005-98db30177f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:16 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Volume 3bde80b6-06dc-4d4a-9410-71ca98eba466: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bde80b6-06dc-4d4a-9410-71ca98eba466', 'volume_size': 1} Sep 10 15:31:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:31:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31389488-d4fb-4a89-8ca9-dc1facc09a69 1073741824" returned: 0 in 0.898s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31389488-d4fb-4a89-8ca9-dc1facc09a69 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31389488-d4fb-4a89-8ca9-dc1facc09a69" returned: 0 in 0.125s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:17 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] <== create_volume: return (1162ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:31:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:31:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.414s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:31:17 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e3886c8d-b79d-4470-87fa-64b1157f9eef,created_at=2025-09-10T13:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-557376530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e3886c8d-b79d-4470-87fa-64b1157f9eef,host='devstack@QuobyteHD#QuobyteHD',id=3bde80b6-06dc-4d4a-9410-71ca98eba466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90d78fb80fca4cb4b7eed18607551ae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:31:16Z,use_quota=True,user_id='61184f76f06c408982d044bb6dc422b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(801a7832-fdca-4900-b752-f68f6c6b5583),volume_type_id=801a7832-fdca-4900-b752-f68f6c6b5583)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:31:17 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Creating volume 3bde80b6-06dc-4d4a-9410-71ca98eba466 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:31:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:31:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:31:17 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:31:17 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:31:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:31:17 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:31:17 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:31:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:17 devstack quobyte-client[82814]: System call of process 91201 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:31:17 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=31, name=volume-3bde80b6-06dc-4d4a-9410-71ca98eba466, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:31:17 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a6e779-7048-47d9-9b68-c35a53581ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31389488-d4fb-4a89-8ca9-dc1facc09a69', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:17 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4308bc38-fc83-4a5c-bb2c-4f18bd3a3759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:17 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Volume volume-31389488-d4fb-4a89-8ca9-dc1facc09a69 (31389488-d4fb-4a89-8ca9-dc1facc09a69): created successfully Sep 10 15:31:17 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4308bc38-fc83-4a5c-bb2c-4f18bd3a3759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:17 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Flow 'volume_create_manager' (949b725e-8064-4296-b898-b193381939a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:31:17 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-acfcc2c8-9b26-4cb4-8426-d3d223ffa1a6 tempest-VolumesTestJSON-2055913451 None] Created volume successfully. Sep 10 15:31:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466 1073741824" returned: 0 in 0.601s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466" returned: 0 in 0.175s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:18 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] <== create_volume: return (835ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:31:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:31:18 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ed2cc6-bfdf-479e-9005-98db30177f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bde80b6-06dc-4d4a-9410-71ca98eba466', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:18 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2f06e0-ab07-4d19-95ce-67c80817acf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:18 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Volume volume-3bde80b6-06dc-4d4a-9410-71ca98eba466 (3bde80b6-06dc-4d4a-9410-71ca98eba466): created successfully Sep 10 15:31:18 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2f06e0-ab07-4d19-95ce-67c80817acf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:18 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Flow 'volume_create_manager' (47ac7a43-bb63-4b47-a57d-891d321256a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:31:18 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-a327acb1-0c24-4c34-b296-a70ee663f8db tempest-GroupSnapshotsTest-829329676 None] Created volume successfully. Sep 10 15:31:19 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-1c45f852-8e6c-4e76-9ec3-38bf99b381a1 tempest-GroupSnapshotsTest-829329676 None] GroupSnapshot 787bd594-e2df-426b-95eb-279667ffad56: creating. Sep 10 15:31:20 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-1c45f852-8e6c-4e76-9ec3-38bf99b381a1 tempest-GroupSnapshotsTest-829329676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:31:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1c45f852-8e6c-4e76-9ec3-38bf99b381a1 tempest-GroupSnapshotsTest-829329676 None] Group snapshot 787bd594-e2df-426b-95eb-279667ffad56: creating. {{(pid=82800) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 10 15:31:20 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:31:20 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:31:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Flow 'volume_create_manager' (cd4eb053-6ccc-4328-9564-f5ba1cedc37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:31:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896a5c76-5efd-4271-b0b7-ac95ddd33a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-1c45f852-8e6c-4e76-9ec3-38bf99b381a1 tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:31:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-1c45f852-8e6c-4e76-9ec3-38bf99b381a1 tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:31:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896a5c76-5efd-4271-b0b7-ac95ddd33a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2125526081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e0d509f-c58e-4d08-bd10-f12c0fa6330e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='84afa81712034c68a956ef90db7b815f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:31:20Z,use_quota=True,user_id='397bcd7a70ea4d4ba8d764de688cc474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39321e43-15b3-48e3-8c58-4248b730cbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39321e43-15b3-48e3-8c58-4248b730cbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fcd58b-de83-4a0d-ad5f-e6743409746d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7fcd58b-de83-4a0d-ad5f-e6743409746d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e0d509f-c58e-4d08-bd10-f12c0fa6330e', 'volume_name': 'volume-7e0d509f-c58e-4d08-bd10-f12c0fa6330e', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eccbf27f-9531-4be6-9453-4baac78ba55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eccbf27f-9531-4be6-9453-4baac78ba55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc7e80a-d589-4d32-8f15-ee6d8d5fe5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:20 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Volume 7e0d509f-c58e-4d08-bd10-f12c0fa6330e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e0d509f-c58e-4d08-bd10-f12c0fa6330e', 'volume_size': 1} Sep 10 15:31:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:31:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-1c45f852-8e6c-4e76-9ec3-38bf99b381a1 tempest-GroupSnapshotsTest-829329676 None] Creating offline snapshot 07cdcadc-ec30-4384-abf0-f03f56aecf86 of volume 3bde80b6-06dc-4d4a-9410-71ca98eba466 {{(pid=82800) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 15:31:20 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b82d4a-abe6-4a04-90cf-328983466f87]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:31:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1c45f852-8e6c-4e76-9ec3-38bf99b381a1 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1c45f852-8e6c-4e76-9ec3-38bf99b381a1 tempest-GroupSnapshotsTest-829329676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466" returned: 0 in 0.468s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1c45f852-8e6c-4e76-9ec3-38bf99b381a1 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466.07cdcadc-ec30-4384-abf0-f03f56aecf86 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:21 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=32, name=volume-3bde80b6-06dc-4d4a-9410-71ca98eba466.07cdcadc-ec30-4384-abf0-f03f56aecf86, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:31:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1c45f852-8e6c-4e76-9ec3-38bf99b381a1 tempest-GroupSnapshotsTest-829329676 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466.07cdcadc-ec30-4384-abf0-f03f56aecf86 1G" returned: 0 in 0.332s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1c45f852-8e6c-4e76-9ec3-38bf99b381a1 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): qemu-img rebase -u -b volume-3bde80b6-06dc-4d4a-9410-71ca98eba466 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466.07cdcadc-ec30-4384-abf0-f03f56aecf86 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1c45f852-8e6c-4e76-9ec3-38bf99b381a1 tempest-GroupSnapshotsTest-829329676 None] CMD "qemu-img rebase -u -b volume-3bde80b6-06dc-4d4a-9410-71ca98eba466 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466.07cdcadc-ec30-4384-abf0-f03f56aecf86" returned: 0 in 0.189s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-1c45f852-8e6c-4e76-9ec3-38bf99b381a1 tempest-GroupSnapshotsTest-829329676 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466.07cdcadc-ec30-4384-abf0-f03f56aecf86 is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:31:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1c45f852-8e6c-4e76-9ec3-38bf99b381a1 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466.07cdcadc-ec30-4384-abf0-f03f56aecf86 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1c45f852-8e6c-4e76-9ec3-38bf99b381a1 tempest-GroupSnapshotsTest-829329676 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466.07cdcadc-ec30-4384-abf0-f03f56aecf86" returned: 0 in 0.111s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-1c45f852-8e6c-4e76-9ec3-38bf99b381a1 tempest-GroupSnapshotsTest-829329676 None] Setting permissions: /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466 -> 1000:1000 {{(pid=82800) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 15:31:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1c45f852-8e6c-4e76-9ec3-38bf99b381a1 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466.07cdcadc-ec30-4384-abf0-f03f56aecf86 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1c45f852-8e6c-4e76-9ec3-38bf99b381a1 tempest-GroupSnapshotsTest-829329676 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466.07cdcadc-ec30-4384-abf0-f03f56aecf86" returned: 0 in 0.100s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1c45f852-8e6c-4e76-9ec3-38bf99b381a1 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1c45f852-8e6c-4e76-9ec3-38bf99b381a1 tempest-GroupSnapshotsTest-829329676 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466.info" returned: 0 in 0.100s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-1c45f852-8e6c-4e76-9ec3-38bf99b381a1 tempest-GroupSnapshotsTest-829329676 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466.info is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:31:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1c45f852-8e6c-4e76-9ec3-38bf99b381a1 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1c45f852-8e6c-4e76-9ec3-38bf99b381a1 tempest-GroupSnapshotsTest-829329676 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466.info" returned: 0 in 0.080s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-1c45f852-8e6c-4e76-9ec3-38bf99b381a1 tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.846s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:31:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.848s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:31:22 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2125526081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e0d509f-c58e-4d08-bd10-f12c0fa6330e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='84afa81712034c68a956ef90db7b815f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:31:20Z,use_quota=True,user_id='397bcd7a70ea4d4ba8d764de688cc474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:31:22 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Creating volume 7e0d509f-c58e-4d08-bd10-f12c0fa6330e {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:31:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:31:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:31:22 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:31:22 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:31:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:31:22 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:31:22 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:31:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7e0d509f-c58e-4d08-bd10-f12c0fa6330e 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:22 devstack quobyte-client[82814]: System call of process 91220 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:31:22 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=34, name=volume-7e0d509f-c58e-4d08-bd10-f12c0fa6330e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:31:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7e0d509f-c58e-4d08-bd10-f12c0fa6330e 1073741824" returned: 0 in 0.408s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7e0d509f-c58e-4d08-bd10-f12c0fa6330e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7e0d509f-c58e-4d08-bd10-f12c0fa6330e" returned: 0 in 0.328s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:22 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] <== create_volume: return (806ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:31:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:31:23 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-1c45f852-8e6c-4e76-9ec3-38bf99b381a1 tempest-GroupSnapshotsTest-829329676 None] group_snapshot 787bd594-e2df-426b-95eb-279667ffad56: created successfully Sep 10 15:31:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc7e80a-d589-4d32-8f15-ee6d8d5fe5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e0d509f-c58e-4d08-bd10-f12c0fa6330e', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a956444-de26-4fba-b6bc-3893896eadab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:23 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Volume volume-7e0d509f-c58e-4d08-bd10-f12c0fa6330e (7e0d509f-c58e-4d08-bd10-f12c0fa6330e): created successfully Sep 10 15:31:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a956444-de26-4fba-b6bc-3893896eadab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Flow 'volume_create_manager' (cd4eb053-6ccc-4328-9564-f5ba1cedc37d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:31:23 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-ce3245b7-9fb3-4465-99cf-edbed839bf4f tempest-VolumesTestJSON-2055913451 None] Created volume successfully. Sep 10 15:31:23 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-b33c36bd-8fff-4f2b-87ea-4b423b54153a tempest-GroupSnapshotsTest-829329676 None] group_snapshot 787bd594-e2df-426b-95eb-279667ffad56: deleting Sep 10 15:31:23 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-b33c36bd-8fff-4f2b-87ea-4b423b54153a tempest-GroupSnapshotsTest-829329676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:31:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b33c36bd-8fff-4f2b-87ea-4b423b54153a tempest-GroupSnapshotsTest-829329676 None] group_snapshot 787bd594-e2df-426b-95eb-279667ffad56: deleting {{(pid=82800) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 10 15:31:23 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b33c36bd-8fff-4f2b-87ea-4b423b54153a tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "cinder-quobyte-3bde80b6-06dc-4d4a-9410-71ca98eba466" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:31:23 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b33c36bd-8fff-4f2b-87ea-4b423b54153a tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-3bde80b6-06dc-4d4a-9410-71ca98eba466" acquired by "delete_snapshot" :: waited 0.045s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:31:23 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b33c36bd-8fff-4f2b-87ea-4b423b54153a tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "cinder-quobyte-07cdcadc-ec30-4384-abf0-f03f56aecf86" by "_delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:31:23 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b33c36bd-8fff-4f2b-87ea-4b423b54153a tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-07cdcadc-ec30-4384-abf0-f03f56aecf86" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:31:23 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-b33c36bd-8fff-4f2b-87ea-4b423b54153a tempest-GroupSnapshotsTest-829329676 None] Deleting offline snapshot 07cdcadc-ec30-4384-abf0-f03f56aecf86 of volume 3bde80b6-06dc-4d4a-9410-71ca98eba466 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 15:31:23 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-b33c36bd-8fff-4f2b-87ea-4b423b54153a tempest-GroupSnapshotsTest-829329676 None] snapshot_file for this snap is: volume-3bde80b6-06dc-4d4a-9410-71ca98eba466.07cdcadc-ec30-4384-abf0-f03f56aecf86 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 15:31:23 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[97abf8a5-3d27-4098-873c-a4382e852117]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:31:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b33c36bd-8fff-4f2b-87ea-4b423b54153a tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466.07cdcadc-ec30-4384-abf0-f03f56aecf86 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b33c36bd-8fff-4f2b-87ea-4b423b54153a tempest-GroupSnapshotsTest-829329676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466.07cdcadc-ec30-4384-abf0-f03f56aecf86" returned: 0 in 0.402s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:24 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-b33c36bd-8fff-4f2b-87ea-4b423b54153a tempest-GroupSnapshotsTest-829329676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bde80b6-06dc-4d4a-9410-71ca98eba466(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:31:24 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8e4e0f-65af-4170-a978-44cab445518d]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:31:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b33c36bd-8fff-4f2b-87ea-4b423b54153a tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b33c36bd-8fff-4f2b-87ea-4b423b54153a tempest-GroupSnapshotsTest-829329676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466" returned: 0 in 0.552s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b33c36bd-8fff-4f2b-87ea-4b423b54153a tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466.07cdcadc-ec30-4384-abf0-f03f56aecf86 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:24 devstack quobyte-client[82814]: System call of process 91230 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:31:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b33c36bd-8fff-4f2b-87ea-4b423b54153a tempest-GroupSnapshotsTest-829329676 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466.07cdcadc-ec30-4384-abf0-f03f56aecf86" returned: 0 in 0.422s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b33c36bd-8fff-4f2b-87ea-4b423b54153a tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466.07cdcadc-ec30-4384-abf0-f03f56aecf86 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:25 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:31:25 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:31:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Flow 'volume_create_manager' (841973cd-5b55-4db5-8b78-28fa4861ec54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:31:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfcdfcfa-2a10-4a9c-b3be-0dd8f57c9bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfcdfcfa-2a10-4a9c-b3be-0dd8f57c9bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-713677618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e7a2055-4b1f-4478-923c-cb90236f4bfb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='84afa81712034c68a956ef90db7b815f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:31:25Z,use_quota=True,user_id='397bcd7a70ea4d4ba8d764de688cc474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c6b088-c1d9-499e-8c6e-34616fd9328c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11c6b088-c1d9-499e-8c6e-34616fd9328c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35261a7b-8baf-4e25-bcf9-c36540782770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35261a7b-8baf-4e25-bcf9-c36540782770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e7a2055-4b1f-4478-923c-cb90236f4bfb', 'volume_name': 'volume-4e7a2055-4b1f-4478-923c-cb90236f4bfb', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (511e205c-e80f-4480-b924-ae59b34953ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (511e205c-e80f-4480-b924-ae59b34953ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fedb06f-6e26-42b4-8bae-f16aa8efb74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:25 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Volume 4e7a2055-4b1f-4478-923c-cb90236f4bfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e7a2055-4b1f-4478-923c-cb90236f4bfb', 'volume_size': 1} Sep 10 15:31:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:31:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:31:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-713677618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e7a2055-4b1f-4478-923c-cb90236f4bfb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='84afa81712034c68a956ef90db7b815f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:31:25Z,use_quota=True,user_id='397bcd7a70ea4d4ba8d764de688cc474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:31:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Creating volume 4e7a2055-4b1f-4478-923c-cb90236f4bfb {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:31:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:31:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:31:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:31:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:31:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:31:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:31:25 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:31:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4e7a2055-4b1f-4478-923c-cb90236f4bfb 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b33c36bd-8fff-4f2b-87ea-4b423b54153a tempest-GroupSnapshotsTest-829329676 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466.07cdcadc-ec30-4384-abf0-f03f56aecf86" returned: 0 in 0.527s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:25 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=35, name=volume-4e7a2055-4b1f-4478-923c-cb90236f4bfb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:31:25 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b33c36bd-8fff-4f2b-87ea-4b423b54153a tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-07cdcadc-ec30-4384-abf0-f03f56aecf86" released by "_delete_snapshot" :: held 2.318s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:31:25 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b33c36bd-8fff-4f2b-87ea-4b423b54153a tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-3bde80b6-06dc-4d4a-9410-71ca98eba466" released by "delete_snapshot" :: held 2.342s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:31:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4e7a2055-4b1f-4478-923c-cb90236f4bfb 1073741824" returned: 0 in 0.440s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4e7a2055-4b1f-4478-923c-cb90236f4bfb {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4e7a2055-4b1f-4478-923c-cb90236f4bfb" returned: 0 in 0.301s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] <== create_volume: return (779ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:31:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:31:26 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fedb06f-6e26-42b4-8bae-f16aa8efb74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e7a2055-4b1f-4478-923c-cb90236f4bfb', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:26 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95156fbd-6a1e-44c1-b993-f38379e87035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:26 devstack cinder-volume[82800]: WARNING cinder.quota [None req-b33c36bd-8fff-4f2b-87ea-4b423b54153a tempest-GroupSnapshotsTest-829329676 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-886117035 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-886117035, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:31:26 devstack cinder-volume[82800]: WARNING cinder.quota [None req-b33c36bd-8fff-4f2b-87ea-4b423b54153a tempest-GroupSnapshotsTest-829329676 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-886117035 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-886117035, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:31:26 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Volume volume-4e7a2055-4b1f-4478-923c-cb90236f4bfb (4e7a2055-4b1f-4478-923c-cb90236f4bfb): created successfully Sep 10 15:31:26 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95156fbd-6a1e-44c1-b993-f38379e87035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:26 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Flow 'volume_create_manager' (841973cd-5b55-4db5-8b78-28fa4861ec54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:31:26 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-50784627-45ba-4937-805c-32508e4b0bf9 tempest-VolumesTestJSON-2055913451 None] Created volume successfully. Sep 10 15:31:26 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-b33c36bd-8fff-4f2b-87ea-4b423b54153a tempest-GroupSnapshotsTest-829329676 None] Created reservations ['ce1952f5-578d-420b-a27a-d5c00b08a749', '715cac6b-13af-4958-826b-bc7f44ae617b', 'dde51472-b12c-4ccd-a4cc-75500d8b8eae', 'c474562d-8a11-4878-971b-b4762feb764d'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:31:26 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-b33c36bd-8fff-4f2b-87ea-4b423b54153a tempest-GroupSnapshotsTest-829329676 None] group_snapshot 787bd594-e2df-426b-95eb-279667ffad56: deleted successfully Sep 10 15:31:27 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-a8ff2647-3a15-4053-aecb-a3aa51682155 tempest-GroupSnapshotsTest-829329676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:31:27 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a8ff2647-3a15-4053-aecb-a3aa51682155 tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "cinder-quobyte-3bde80b6-06dc-4d4a-9410-71ca98eba466" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:31:27 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a8ff2647-3a15-4053-aecb-a3aa51682155 tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-3bde80b6-06dc-4d4a-9410-71ca98eba466" acquired by "delete_volume" :: waited 0.048s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:31:27 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfedecd-ef79-4b0e-8559-02d801607c60]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:31:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a8ff2647-3a15-4053-aecb-a3aa51682155 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:28 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-28191f62-6cc1-4c0b-967b-3ca58a90b44c tempest-VolumesTestJSON-2055913451 None] Acquiring lock "cinder-4e7a2055-4b1f-4478-923c-cb90236f4bfb-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:31:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a8ff2647-3a15-4053-aecb-a3aa51682155 tempest-GroupSnapshotsTest-829329676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466" returned: 0 in 0.800s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a8ff2647-3a15-4053-aecb-a3aa51682155 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:28 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-28191f62-6cc1-4c0b-967b-3ca58a90b44c tempest-VolumesTestJSON-2055913451 None] Lock "cinder-4e7a2055-4b1f-4478-923c-cb90236f4bfb-delete_volume" acquired by "delete_volume" :: waited 0.212s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:31:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a8ff2647-3a15-4053-aecb-a3aa51682155 tempest-GroupSnapshotsTest-829329676 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3bde80b6-06dc-4d4a-9410-71ca98eba466" returned: 0 in 0.346s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:28 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a8ff2647-3a15-4053-aecb-a3aa51682155 tempest-GroupSnapshotsTest-829329676 None] Lock "cinder-quobyte-3bde80b6-06dc-4d4a-9410-71ca98eba466" released by "delete_volume" :: held 1.285s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:31:28 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-28191f62-6cc1-4c0b-967b-3ca58a90b44c tempest-VolumesTestJSON-2055913451 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:31:28 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-28191f62-6cc1-4c0b-967b-3ca58a90b44c tempest-VolumesTestJSON-2055913451 None] Acquiring lock "cinder-quobyte-4e7a2055-4b1f-4478-923c-cb90236f4bfb" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:31:28 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-28191f62-6cc1-4c0b-967b-3ca58a90b44c tempest-VolumesTestJSON-2055913451 None] Lock "cinder-quobyte-4e7a2055-4b1f-4478-923c-cb90236f4bfb" acquired by "delete_volume" :: waited 0.047s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:31:28 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e853fe-6aab-40d5-b070-a391e9e2bc01]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:31:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-28191f62-6cc1-4c0b-967b-3ca58a90b44c tempest-VolumesTestJSON-2055913451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4e7a2055-4b1f-4478-923c-cb90236f4bfb {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:31:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:31:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:31:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:31:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:31:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:31:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.372s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:31:29 devstack quobyte-client[82814]: System call of process 91243 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:31:29 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-a8ff2647-3a15-4053-aecb-a3aa51682155 tempest-GroupSnapshotsTest-829329676 None] Created reservations ['992b9f5a-2614-4f31-8b05-0377464b9c36'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:31:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-28191f62-6cc1-4c0b-967b-3ca58a90b44c tempest-VolumesTestJSON-2055913451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4e7a2055-4b1f-4478-923c-cb90236f4bfb" returned: 0 in 0.916s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-28191f62-6cc1-4c0b-967b-3ca58a90b44c tempest-VolumesTestJSON-2055913451 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4e7a2055-4b1f-4478-923c-cb90236f4bfb {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-28191f62-6cc1-4c0b-967b-3ca58a90b44c tempest-VolumesTestJSON-2055913451 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4e7a2055-4b1f-4478-923c-cb90236f4bfb" returned: 0 in 0.301s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:30 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-28191f62-6cc1-4c0b-967b-3ca58a90b44c tempest-VolumesTestJSON-2055913451 None] Lock "cinder-quobyte-4e7a2055-4b1f-4478-923c-cb90236f4bfb" released by "delete_volume" :: held 1.309s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:31:30 devstack cinder-volume[82800]: WARNING cinder.quota [None req-a8ff2647-3a15-4053-aecb-a3aa51682155 tempest-GroupSnapshotsTest-829329676 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-886117035 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-886117035, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:31:30 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-a8ff2647-3a15-4053-aecb-a3aa51682155 tempest-GroupSnapshotsTest-829329676 None] Created reservations ['f9af1eac-0781-4b48-8a60-958aedc9e960', '11219bce-0304-4de6-940c-c44508f63a54', 'cddfb19d-1840-4682-b45e-2d51b693e7c6', 'a1f8151a-0912-4dd8-b032-9d52af701a31'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:31:30 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-28191f62-6cc1-4c0b-967b-3ca58a90b44c tempest-VolumesTestJSON-2055913451 None] Created reservations ['d2185c65-3ef9-426d-905e-cba887568cf5', '879d4943-6e8d-46fc-bb49-dfe6885a563f', '8c65a3b8-2adf-4ab4-afbe-3d99923de6dc', '5a75a875-7351-4ccd-8a8a-ef0352934520'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:31:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-28191f62-6cc1-4c0b-967b-3ca58a90b44c tempest-VolumesTestJSON-2055913451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:31:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-28191f62-6cc1-4c0b-967b-3ca58a90b44c tempest-VolumesTestJSON-2055913451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:31:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-28191f62-6cc1-4c0b-967b-3ca58a90b44c tempest-VolumesTestJSON-2055913451 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:31:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-28191f62-6cc1-4c0b-967b-3ca58a90b44c tempest-VolumesTestJSON-2055913451 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:31:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-28191f62-6cc1-4c0b-967b-3ca58a90b44c tempest-VolumesTestJSON-2055913451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:31:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-28191f62-6cc1-4c0b-967b-3ca58a90b44c tempest-VolumesTestJSON-2055913451 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-28191f62-6cc1-4c0b-967b-3ca58a90b44c tempest-VolumesTestJSON-2055913451 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.311s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:30 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-28191f62-6cc1-4c0b-967b-3ca58a90b44c tempest-VolumesTestJSON-2055913451 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:31:30 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-28191f62-6cc1-4c0b-967b-3ca58a90b44c tempest-VolumesTestJSON-2055913451 None] Deleted volume successfully. Sep 10 15:31:30 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-28191f62-6cc1-4c0b-967b-3ca58a90b44c tempest-VolumesTestJSON-2055913451 None] Lock "cinder-4e7a2055-4b1f-4478-923c-cb90236f4bfb-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:31:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a8ff2647-3a15-4053-aecb-a3aa51682155 tempest-GroupSnapshotsTest-829329676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:31:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a8ff2647-3a15-4053-aecb-a3aa51682155 tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:31:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a8ff2647-3a15-4053-aecb-a3aa51682155 tempest-GroupSnapshotsTest-829329676 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:31:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a8ff2647-3a15-4053-aecb-a3aa51682155 tempest-GroupSnapshotsTest-829329676 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:31:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a8ff2647-3a15-4053-aecb-a3aa51682155 tempest-GroupSnapshotsTest-829329676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:31:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a8ff2647-3a15-4053-aecb-a3aa51682155 tempest-GroupSnapshotsTest-829329676 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a8ff2647-3a15-4053-aecb-a3aa51682155 tempest-GroupSnapshotsTest-829329676 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.094s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:31 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-a8ff2647-3a15-4053-aecb-a3aa51682155 tempest-GroupSnapshotsTest-829329676 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:31:31 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-a8ff2647-3a15-4053-aecb-a3aa51682155 tempest-GroupSnapshotsTest-829329676 None] Delete group completed successfully. Sep 10 15:31:31 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-7f3a45a3-3a56-4943-ac08-ecc664593d98 tempest-VolumesTestJSON-2055913451 None] Acquiring lock "cinder-7e0d509f-c58e-4d08-bd10-f12c0fa6330e-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:31:31 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-7f3a45a3-3a56-4943-ac08-ecc664593d98 tempest-VolumesTestJSON-2055913451 None] Lock "cinder-7e0d509f-c58e-4d08-bd10-f12c0fa6330e-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:31:31 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-7f3a45a3-3a56-4943-ac08-ecc664593d98 tempest-VolumesTestJSON-2055913451 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:31:31 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-7f3a45a3-3a56-4943-ac08-ecc664593d98 tempest-VolumesTestJSON-2055913451 None] Acquiring lock "cinder-quobyte-7e0d509f-c58e-4d08-bd10-f12c0fa6330e" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:31:31 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-7f3a45a3-3a56-4943-ac08-ecc664593d98 tempest-VolumesTestJSON-2055913451 None] Lock "cinder-quobyte-7e0d509f-c58e-4d08-bd10-f12c0fa6330e" acquired by "delete_volume" :: waited 0.024s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:31:31 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc37eaa-010f-4d68-b08e-677d055abdc4]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:31:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7f3a45a3-3a56-4943-ac08-ecc664593d98 tempest-VolumesTestJSON-2055913451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7e0d509f-c58e-4d08-bd10-f12c0fa6330e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:32 devstack quobyte-client[82814]: System call of process 91252 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:31:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7f3a45a3-3a56-4943-ac08-ecc664593d98 tempest-VolumesTestJSON-2055913451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7e0d509f-c58e-4d08-bd10-f12c0fa6330e" returned: 0 in 0.753s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7f3a45a3-3a56-4943-ac08-ecc664593d98 tempest-VolumesTestJSON-2055913451 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7e0d509f-c58e-4d08-bd10-f12c0fa6330e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7f3a45a3-3a56-4943-ac08-ecc664593d98 tempest-VolumesTestJSON-2055913451 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7e0d509f-c58e-4d08-bd10-f12c0fa6330e" returned: 0 in 0.170s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:33 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-7f3a45a3-3a56-4943-ac08-ecc664593d98 tempest-VolumesTestJSON-2055913451 None] Lock "cinder-quobyte-7e0d509f-c58e-4d08-bd10-f12c0fa6330e" released by "delete_volume" :: held 1.112s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:31:33 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-7f3a45a3-3a56-4943-ac08-ecc664593d98 tempest-VolumesTestJSON-2055913451 None] Created reservations ['5f71abf1-0761-434c-a3f2-bf8e3ccc5084', '22b88d33-cc84-4884-ba3d-315978beb0c8', 'f523e889-13f7-4b10-89b3-236b719781ff', 'e4d35cbb-5381-4feb-bf6c-d6068128d922'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:31:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7f3a45a3-3a56-4943-ac08-ecc664593d98 tempest-VolumesTestJSON-2055913451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:31:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7f3a45a3-3a56-4943-ac08-ecc664593d98 tempest-VolumesTestJSON-2055913451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:31:33 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7f3a45a3-3a56-4943-ac08-ecc664593d98 tempest-VolumesTestJSON-2055913451 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:31:33 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7f3a45a3-3a56-4943-ac08-ecc664593d98 tempest-VolumesTestJSON-2055913451 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:31:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7f3a45a3-3a56-4943-ac08-ecc664593d98 tempest-VolumesTestJSON-2055913451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:31:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7f3a45a3-3a56-4943-ac08-ecc664593d98 tempest-VolumesTestJSON-2055913451 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:34 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-800d9af9-8772-4b1c-93a0-e256eb3fcaab tempest-VolumesTestJSON-2055913451 None] Acquiring lock "cinder-31389488-d4fb-4a89-8ca9-dc1facc09a69-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:31:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7f3a45a3-3a56-4943-ac08-ecc664593d98 tempest-VolumesTestJSON-2055913451 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.478s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:34 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-7f3a45a3-3a56-4943-ac08-ecc664593d98 tempest-VolumesTestJSON-2055913451 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:31:34 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-7f3a45a3-3a56-4943-ac08-ecc664593d98 tempest-VolumesTestJSON-2055913451 None] Deleted volume successfully. Sep 10 15:31:34 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-800d9af9-8772-4b1c-93a0-e256eb3fcaab tempest-VolumesTestJSON-2055913451 None] Lock "cinder-31389488-d4fb-4a89-8ca9-dc1facc09a69-delete_volume" acquired by "delete_volume" :: waited 0.224s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:31:34 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-7f3a45a3-3a56-4943-ac08-ecc664593d98 tempest-VolumesTestJSON-2055913451 None] Lock "cinder-7e0d509f-c58e-4d08-bd10-f12c0fa6330e-delete_volume" released by "delete_volume" :: held 2.868s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:31:34 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-800d9af9-8772-4b1c-93a0-e256eb3fcaab tempest-VolumesTestJSON-2055913451 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:31:34 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-800d9af9-8772-4b1c-93a0-e256eb3fcaab tempest-VolumesTestJSON-2055913451 None] Acquiring lock "cinder-quobyte-31389488-d4fb-4a89-8ca9-dc1facc09a69" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:31:34 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-800d9af9-8772-4b1c-93a0-e256eb3fcaab tempest-VolumesTestJSON-2055913451 None] Lock "cinder-quobyte-31389488-d4fb-4a89-8ca9-dc1facc09a69" acquired by "delete_volume" :: waited 0.040s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:31:34 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[56305e17-c81c-4376-be07-d1e1a5bb58b0]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:31:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-800d9af9-8772-4b1c-93a0-e256eb3fcaab tempest-VolumesTestJSON-2055913451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31389488-d4fb-4a89-8ca9-dc1facc09a69 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-800d9af9-8772-4b1c-93a0-e256eb3fcaab tempest-VolumesTestJSON-2055913451 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31389488-d4fb-4a89-8ca9-dc1facc09a69" returned: 0 in 0.599s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-800d9af9-8772-4b1c-93a0-e256eb3fcaab tempest-VolumesTestJSON-2055913451 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31389488-d4fb-4a89-8ca9-dc1facc09a69 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-800d9af9-8772-4b1c-93a0-e256eb3fcaab tempest-VolumesTestJSON-2055913451 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31389488-d4fb-4a89-8ca9-dc1facc09a69" returned: 0 in 0.131s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:35 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-800d9af9-8772-4b1c-93a0-e256eb3fcaab tempest-VolumesTestJSON-2055913451 None] Lock "cinder-quobyte-31389488-d4fb-4a89-8ca9-dc1facc09a69" released by "delete_volume" :: held 0.960s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:31:36 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-800d9af9-8772-4b1c-93a0-e256eb3fcaab tempest-VolumesTestJSON-2055913451 None] Created reservations ['d102bde1-120a-4b79-8a93-3a39c87f505f', '59e53959-0373-4d01-93fe-742cbd06805f', 'd5b26cb9-3c7a-4d98-a7cd-157a89fe3fd4', '5ed5ca3d-eca6-4ca9-9cac-ba23ba9bd0e1'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:31:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-800d9af9-8772-4b1c-93a0-e256eb3fcaab tempest-VolumesTestJSON-2055913451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:31:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-800d9af9-8772-4b1c-93a0-e256eb3fcaab tempest-VolumesTestJSON-2055913451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:31:36 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-800d9af9-8772-4b1c-93a0-e256eb3fcaab tempest-VolumesTestJSON-2055913451 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:31:36 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-800d9af9-8772-4b1c-93a0-e256eb3fcaab tempest-VolumesTestJSON-2055913451 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:31:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-800d9af9-8772-4b1c-93a0-e256eb3fcaab tempest-VolumesTestJSON-2055913451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:31:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-800d9af9-8772-4b1c-93a0-e256eb3fcaab tempest-VolumesTestJSON-2055913451 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-800d9af9-8772-4b1c-93a0-e256eb3fcaab tempest-VolumesTestJSON-2055913451 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.220s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:36 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-800d9af9-8772-4b1c-93a0-e256eb3fcaab tempest-VolumesTestJSON-2055913451 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:31:36 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-800d9af9-8772-4b1c-93a0-e256eb3fcaab tempest-VolumesTestJSON-2055913451 None] Deleted volume successfully. Sep 10 15:31:36 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-800d9af9-8772-4b1c-93a0-e256eb3fcaab tempest-VolumesTestJSON-2055913451 None] Lock "cinder-31389488-d4fb-4a89-8ca9-dc1facc09a69-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:31:46 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=52,cinder:INSERT=22,cinder:UPDATE=69,cinder:DELETE=4 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:31:46 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=68,cinder:INSERT=12,cinder:UPDATE=86,cinder:DELETE=4 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:31:48 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-62c07397-ac66-44ae-86db-bcf29858d36b tempest-GroupSnapshotsV319Test-1513661982 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:31:48 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-62c07397-ac66-44ae-86db-bcf29858d36b tempest-GroupSnapshotsV319Test-1513661982 None] Group tempest-GroupSnapshotsV319Test-Group-1918751250: creating Sep 10 15:31:48 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-62c07397-ac66-44ae-86db-bcf29858d36b tempest-GroupSnapshotsV319Test-1513661982 None] Group tempest-GroupSnapshotsV319Test-Group-1918751250: created successfully Sep 10 15:31:48 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-62c07397-ac66-44ae-86db-bcf29858d36b tempest-GroupSnapshotsV319Test-1513661982 None] Create group completed successfully. Sep 10 15:31:51 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:31:51 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:31:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Flow 'volume_create_manager' (f7bdeaea-b489-4723-bc5d-f2194faea76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:31:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4823a5-7931-406d-af6c-23a110417e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4823a5-7931-406d-af6c-23a110417e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-582587308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7ea99b3a-4042-4433-9596-719d254c1c55,host='devstack@QuobyteHD#QuobyteHD',id=ded882ea-1540-4a69-82a3-c71a9f931e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='511878e3ac444a71a9fda4b4922b2b34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:31:51Z,use_quota=True,user_id='e77d153024a0409c8db8ab3b91e2073a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4789ea05-b779-47d6-afd3-cf2243837578),volume_type_id=4789ea05-b779-47d6-afd3-cf2243837578)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9206a1eb-5e15-47fb-9037-6ec35141b73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9206a1eb-5e15-47fb-9037-6ec35141b73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6330dd1-aa37-4aba-9742-f845bf4f87e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6330dd1-aa37-4aba-9742-f845bf4f87e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ded882ea-1540-4a69-82a3-c71a9f931e60', 'volume_name': 'volume-ded882ea-1540-4a69-82a3-c71a9f931e60', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aac7cdd-1f67-443f-bf59-231768e0ea71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aac7cdd-1f67-443f-bf59-231768e0ea71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2264364e-caf7-4446-bdf9-0eac1c595d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:51 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Volume ded882ea-1540-4a69-82a3-c71a9f931e60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ded882ea-1540-4a69-82a3-c71a9f931e60', 'volume_size': 1} Sep 10 15:31:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:31:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:31:51 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7ea99b3a-4042-4433-9596-719d254c1c55,created_at=2025-09-10T13:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-582587308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7ea99b3a-4042-4433-9596-719d254c1c55,host='devstack@QuobyteHD#QuobyteHD',id=ded882ea-1540-4a69-82a3-c71a9f931e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='511878e3ac444a71a9fda4b4922b2b34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:31:51Z,use_quota=True,user_id='e77d153024a0409c8db8ab3b91e2073a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4789ea05-b779-47d6-afd3-cf2243837578),volume_type_id=4789ea05-b779-47d6-afd3-cf2243837578)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:31:51 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Creating volume ded882ea-1540-4a69-82a3-c71a9f931e60 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:31:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:31:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:31:51 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:31:51 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:31:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:31:51 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:31:51 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:31:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:51 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=36, name=volume-ded882ea-1540-4a69-82a3-c71a9f931e60, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:31:51 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-691e198a-db2c-41aa-89fe-9d9966267bbe tempest-GroupsV320Test-1266556398 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:31:51 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-691e198a-db2c-41aa-89fe-9d9966267bbe tempest-GroupsV320Test-1266556398 None] Group tempest-GroupsV320Test-Group-1774876837: creating Sep 10 15:31:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60 1073741824" returned: 0 in 0.617s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60" returned: 0 in 0.373s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] <== create_volume: return (1044ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:31:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:31:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2264364e-caf7-4446-bdf9-0eac1c595d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ded882ea-1540-4a69-82a3-c71a9f931e60', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7df3bbc-6674-46e1-b2d3-6a450180caa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:31:52 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-691e198a-db2c-41aa-89fe-9d9966267bbe tempest-GroupsV320Test-1266556398 None] Group tempest-GroupsV320Test-Group-1774876837: created successfully Sep 10 15:31:52 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-691e198a-db2c-41aa-89fe-9d9966267bbe tempest-GroupsV320Test-1266556398 None] Create group completed successfully. Sep 10 15:31:52 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Volume volume-ded882ea-1540-4a69-82a3-c71a9f931e60 (ded882ea-1540-4a69-82a3-c71a9f931e60): created successfully Sep 10 15:31:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7df3bbc-6674-46e1-b2d3-6a450180caa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:31:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Flow 'volume_create_manager' (f7bdeaea-b489-4723-bc5d-f2194faea76f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:31:52 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-2544d422-ec7b-4ab5-8c7a-b687070c6f7b tempest-GroupSnapshotsV319Test-1513661982 None] Created volume successfully. Sep 10 15:31:53 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-7fe05141-3392-41cd-aa3f-dbf286ae86ef tempest-GroupsV320Test-1266556398 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:31:53 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-7fe05141-3392-41cd-aa3f-dbf286ae86ef tempest-GroupsV320Test-1266556398 None] Created reservations ['8a4cec78-1846-49c4-92b0-ec9e6351a7de'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:31:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7fe05141-3392-41cd-aa3f-dbf286ae86ef tempest-GroupsV320Test-1266556398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:31:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7fe05141-3392-41cd-aa3f-dbf286ae86ef tempest-GroupsV320Test-1266556398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:31:54 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7fe05141-3392-41cd-aa3f-dbf286ae86ef tempest-GroupsV320Test-1266556398 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:31:54 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7fe05141-3392-41cd-aa3f-dbf286ae86ef tempest-GroupsV320Test-1266556398 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:31:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7fe05141-3392-41cd-aa3f-dbf286ae86ef tempest-GroupsV320Test-1266556398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:31:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7fe05141-3392-41cd-aa3f-dbf286ae86ef tempest-GroupsV320Test-1266556398 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:54 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-5b7ee549-7643-4c83-9946-8886440903d7 tempest-GroupSnapshotsV319Test-1513661982 None] GroupSnapshot 1cd7ad22-581a-493b-9379-1cf866824d94: creating. Sep 10 15:31:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7fe05141-3392-41cd-aa3f-dbf286ae86ef tempest-GroupsV320Test-1266556398 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.504s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:54 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-7fe05141-3392-41cd-aa3f-dbf286ae86ef tempest-GroupsV320Test-1266556398 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:31:54 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-7fe05141-3392-41cd-aa3f-dbf286ae86ef tempest-GroupsV320Test-1266556398 None] Delete group completed successfully. Sep 10 15:31:54 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-5b7ee549-7643-4c83-9946-8886440903d7 tempest-GroupSnapshotsV319Test-1513661982 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:31:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-5b7ee549-7643-4c83-9946-8886440903d7 tempest-GroupSnapshotsV319Test-1513661982 None] Group snapshot 1cd7ad22-581a-493b-9379-1cf866824d94: creating. {{(pid=82800) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 10 15:31:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-5b7ee549-7643-4c83-9946-8886440903d7 tempest-GroupSnapshotsV319Test-1513661982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:31:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-5b7ee549-7643-4c83-9946-8886440903d7 tempest-GroupSnapshotsV319Test-1513661982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:31:54 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-5b7ee549-7643-4c83-9946-8886440903d7 tempest-GroupSnapshotsV319Test-1513661982 None] Creating offline snapshot 592e10e1-8a78-4c71-aaa6-f71201269cb6 of volume ded882ea-1540-4a69-82a3-c71a9f931e60 {{(pid=82800) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 15:31:54 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6fe079-08a1-480b-82bd-fddc7bd74ed7]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:31:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b7ee549-7643-4c83-9946-8886440903d7 tempest-GroupSnapshotsV319Test-1513661982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b7ee549-7643-4c83-9946-8886440903d7 tempest-GroupSnapshotsV319Test-1513661982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60" returned: 0 in 1.055s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b7ee549-7643-4c83-9946-8886440903d7 tempest-GroupSnapshotsV319Test-1513661982 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60.592e10e1-8a78-4c71-aaa6-f71201269cb6 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:56 devstack quobyte-client[82814]: System call of process 91339 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:31:56 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=37, name=volume-ded882ea-1540-4a69-82a3-c71a9f931e60.592e10e1-8a78-4c71-aaa6-f71201269cb6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:31:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b7ee549-7643-4c83-9946-8886440903d7 tempest-GroupSnapshotsV319Test-1513661982 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60.592e10e1-8a78-4c71-aaa6-f71201269cb6 1G" returned: 0 in 0.408s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b7ee549-7643-4c83-9946-8886440903d7 tempest-GroupSnapshotsV319Test-1513661982 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ded882ea-1540-4a69-82a3-c71a9f931e60 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60.592e10e1-8a78-4c71-aaa6-f71201269cb6 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b7ee549-7643-4c83-9946-8886440903d7 tempest-GroupSnapshotsV319Test-1513661982 None] CMD "qemu-img rebase -u -b volume-ded882ea-1540-4a69-82a3-c71a9f931e60 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60.592e10e1-8a78-4c71-aaa6-f71201269cb6" returned: 0 in 0.204s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:56 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-5b7ee549-7643-4c83-9946-8886440903d7 tempest-GroupSnapshotsV319Test-1513661982 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60.592e10e1-8a78-4c71-aaa6-f71201269cb6 is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:31:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b7ee549-7643-4c83-9946-8886440903d7 tempest-GroupSnapshotsV319Test-1513661982 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60.592e10e1-8a78-4c71-aaa6-f71201269cb6 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b7ee549-7643-4c83-9946-8886440903d7 tempest-GroupSnapshotsV319Test-1513661982 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60.592e10e1-8a78-4c71-aaa6-f71201269cb6" returned: 0 in 0.115s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:56 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-5b7ee549-7643-4c83-9946-8886440903d7 tempest-GroupSnapshotsV319Test-1513661982 None] Setting permissions: /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60 -> 1000:1000 {{(pid=82800) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 15:31:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b7ee549-7643-4c83-9946-8886440903d7 tempest-GroupSnapshotsV319Test-1513661982 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60.592e10e1-8a78-4c71-aaa6-f71201269cb6 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b7ee549-7643-4c83-9946-8886440903d7 tempest-GroupSnapshotsV319Test-1513661982 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60.592e10e1-8a78-4c71-aaa6-f71201269cb6" returned: 0 in 0.123s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b7ee549-7643-4c83-9946-8886440903d7 tempest-GroupSnapshotsV319Test-1513661982 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b7ee549-7643-4c83-9946-8886440903d7 tempest-GroupSnapshotsV319Test-1513661982 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60.info" returned: 0 in 0.197s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:57 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-5b7ee549-7643-4c83-9946-8886440903d7 tempest-GroupSnapshotsV319Test-1513661982 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60.info is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:31:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b7ee549-7643-4c83-9946-8886440903d7 tempest-GroupSnapshotsV319Test-1513661982 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:31:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b7ee549-7643-4c83-9946-8886440903d7 tempest-GroupSnapshotsV319Test-1513661982 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60.info" returned: 0 in 0.099s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:31:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-5b7ee549-7643-4c83-9946-8886440903d7 tempest-GroupSnapshotsV319Test-1513661982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.708s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:31:57 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-5b7ee549-7643-4c83-9946-8886440903d7 tempest-GroupSnapshotsV319Test-1513661982 None] group_snapshot 1cd7ad22-581a-493b-9379-1cf866824d94: created successfully Sep 10 15:31:59 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-1c81c2d6-44ed-45d5-ba20-17237e35fead tempest-GroupSnapshotsV319Test-1513661982 None] group_snapshot 1cd7ad22-581a-493b-9379-1cf866824d94: deleting Sep 10 15:31:59 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-1c81c2d6-44ed-45d5-ba20-17237e35fead tempest-GroupSnapshotsV319Test-1513661982 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:31:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1c81c2d6-44ed-45d5-ba20-17237e35fead tempest-GroupSnapshotsV319Test-1513661982 None] group_snapshot 1cd7ad22-581a-493b-9379-1cf866824d94: deleting {{(pid=82800) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 10 15:31:59 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-1c81c2d6-44ed-45d5-ba20-17237e35fead tempest-GroupSnapshotsV319Test-1513661982 None] Acquiring lock "cinder-quobyte-ded882ea-1540-4a69-82a3-c71a9f931e60" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:31:59 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-1c81c2d6-44ed-45d5-ba20-17237e35fead tempest-GroupSnapshotsV319Test-1513661982 None] Lock "cinder-quobyte-ded882ea-1540-4a69-82a3-c71a9f931e60" acquired by "delete_snapshot" :: waited 0.075s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:31:59 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-1c81c2d6-44ed-45d5-ba20-17237e35fead tempest-GroupSnapshotsV319Test-1513661982 None] Acquiring lock "cinder-quobyte-592e10e1-8a78-4c71-aaa6-f71201269cb6" by "_delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:31:59 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-1c81c2d6-44ed-45d5-ba20-17237e35fead tempest-GroupSnapshotsV319Test-1513661982 None] Lock "cinder-quobyte-592e10e1-8a78-4c71-aaa6-f71201269cb6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:31:59 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-1c81c2d6-44ed-45d5-ba20-17237e35fead tempest-GroupSnapshotsV319Test-1513661982 None] Deleting offline snapshot 592e10e1-8a78-4c71-aaa6-f71201269cb6 of volume ded882ea-1540-4a69-82a3-c71a9f931e60 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 15:31:59 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-1c81c2d6-44ed-45d5-ba20-17237e35fead tempest-GroupSnapshotsV319Test-1513661982 None] snapshot_file for this snap is: volume-ded882ea-1540-4a69-82a3-c71a9f931e60.592e10e1-8a78-4c71-aaa6-f71201269cb6 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 15:31:59 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc598c3-abbc-43da-8a24-37a9787c3d34]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:31:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1c81c2d6-44ed-45d5-ba20-17237e35fead tempest-GroupSnapshotsV319Test-1513661982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60.592e10e1-8a78-4c71-aaa6-f71201269cb6 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1c81c2d6-44ed-45d5-ba20-17237e35fead tempest-GroupSnapshotsV319Test-1513661982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60.592e10e1-8a78-4c71-aaa6-f71201269cb6" returned: 0 in 0.543s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:00 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-1c81c2d6-44ed-45d5-ba20-17237e35fead tempest-GroupSnapshotsV319Test-1513661982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ded882ea-1540-4a69-82a3-c71a9f931e60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:32:00 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[480aaf4f-69ce-4468-8c72-e65e9b92157d]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:32:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1c81c2d6-44ed-45d5-ba20-17237e35fead tempest-GroupSnapshotsV319Test-1513661982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1c81c2d6-44ed-45d5-ba20-17237e35fead tempest-GroupSnapshotsV319Test-1513661982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60" returned: 0 in 0.487s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1c81c2d6-44ed-45d5-ba20-17237e35fead tempest-GroupSnapshotsV319Test-1513661982 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60.592e10e1-8a78-4c71-aaa6-f71201269cb6 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1c81c2d6-44ed-45d5-ba20-17237e35fead tempest-GroupSnapshotsV319Test-1513661982 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60.592e10e1-8a78-4c71-aaa6-f71201269cb6" returned: 0 in 0.320s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1c81c2d6-44ed-45d5-ba20-17237e35fead tempest-GroupSnapshotsV319Test-1513661982 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60.592e10e1-8a78-4c71-aaa6-f71201269cb6 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1c81c2d6-44ed-45d5-ba20-17237e35fead tempest-GroupSnapshotsV319Test-1513661982 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60.592e10e1-8a78-4c71-aaa6-f71201269cb6" returned: 0 in 0.096s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-1c81c2d6-44ed-45d5-ba20-17237e35fead tempest-GroupSnapshotsV319Test-1513661982 None] Lock "cinder-quobyte-592e10e1-8a78-4c71-aaa6-f71201269cb6" released by "_delete_snapshot" :: held 1.862s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:32:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-1c81c2d6-44ed-45d5-ba20-17237e35fead tempest-GroupSnapshotsV319Test-1513661982 None] Lock "cinder-quobyte-ded882ea-1540-4a69-82a3-c71a9f931e60" released by "delete_snapshot" :: held 1.895s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:32:01 devstack cinder-volume[82800]: WARNING cinder.quota [None req-1c81c2d6-44ed-45d5-ba20-17237e35fead tempest-GroupSnapshotsV319Test-1513661982 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-450489903 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-450489903, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:32:01 devstack cinder-volume[82800]: WARNING cinder.quota [None req-1c81c2d6-44ed-45d5-ba20-17237e35fead tempest-GroupSnapshotsV319Test-1513661982 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-450489903 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-450489903, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:32:01 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-1c81c2d6-44ed-45d5-ba20-17237e35fead tempest-GroupSnapshotsV319Test-1513661982 None] Created reservations ['6a0a2c7b-de19-4a75-9261-40b1cf0c1f49', '1721a1c8-e828-4ce1-b566-92cbae4fa2f6', 'bc456f21-c970-4611-b9e6-c76febcbbd1d', 'b4e1d3a6-9f1a-41b8-bf29-78d3a4aa09ed'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:32:02 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-1c81c2d6-44ed-45d5-ba20-17237e35fead tempest-GroupSnapshotsV319Test-1513661982 None] group_snapshot 1cd7ad22-581a-493b-9379-1cf866824d94: deleted successfully Sep 10 15:32:03 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-3ca70d41-9923-4bd6-a08a-abee9610a03a tempest-GroupSnapshotsV319Test-1513661982 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:32:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-3ca70d41-9923-4bd6-a08a-abee9610a03a tempest-GroupSnapshotsV319Test-1513661982 None] Acquiring lock "cinder-quobyte-ded882ea-1540-4a69-82a3-c71a9f931e60" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:32:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-3ca70d41-9923-4bd6-a08a-abee9610a03a tempest-GroupSnapshotsV319Test-1513661982 None] Lock "cinder-quobyte-ded882ea-1540-4a69-82a3-c71a9f931e60" acquired by "delete_volume" :: waited 0.031s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:32:03 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee6cd05-b590-4bc2-88c1-dbf4a4ba9f97]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:32:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3ca70d41-9923-4bd6-a08a-abee9610a03a tempest-GroupSnapshotsV319Test-1513661982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-35b149d7-6fcb-4008-9ec9-70736288bf44 tempest-AttachVolumeShelveTestJSON-83004131 None] Acquiring lock "cinder-fac56de2-07b7-4af9-989b-d733c463c29e-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:32:04 devstack quobyte-client[82814]: System call of process 91361 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:32:04 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-35b149d7-6fcb-4008-9ec9-70736288bf44 tempest-AttachVolumeShelveTestJSON-83004131 None] Lock "cinder-fac56de2-07b7-4af9-989b-d733c463c29e-delete_volume" acquired by "delete_volume" :: waited 0.131s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:32:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3ca70d41-9923-4bd6-a08a-abee9610a03a tempest-GroupSnapshotsV319Test-1513661982 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60" returned: 0 in 1.007s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3ca70d41-9923-4bd6-a08a-abee9610a03a tempest-GroupSnapshotsV319Test-1513661982 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3ca70d41-9923-4bd6-a08a-abee9610a03a tempest-GroupSnapshotsV319Test-1513661982 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ded882ea-1540-4a69-82a3-c71a9f931e60" returned: 0 in 0.298s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:04 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-3ca70d41-9923-4bd6-a08a-abee9610a03a tempest-GroupSnapshotsV319Test-1513661982 None] Lock "cinder-quobyte-ded882ea-1540-4a69-82a3-c71a9f931e60" released by "delete_volume" :: held 1.498s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:32:04 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-35b149d7-6fcb-4008-9ec9-70736288bf44 tempest-AttachVolumeShelveTestJSON-83004131 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:32:04 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-35b149d7-6fcb-4008-9ec9-70736288bf44 tempest-AttachVolumeShelveTestJSON-83004131 None] Acquiring lock "cinder-quobyte-fac56de2-07b7-4af9-989b-d733c463c29e" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:32:04 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-35b149d7-6fcb-4008-9ec9-70736288bf44 tempest-AttachVolumeShelveTestJSON-83004131 None] Lock "cinder-quobyte-fac56de2-07b7-4af9-989b-d733c463c29e" acquired by "delete_volume" :: waited 0.055s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:32:04 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1da81b1-a32a-4df5-843a-7302f1b78333]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:32:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-35b149d7-6fcb-4008-9ec9-70736288bf44 tempest-AttachVolumeShelveTestJSON-83004131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-fac56de2-07b7-4af9-989b-d733c463c29e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:05 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-3ca70d41-9923-4bd6-a08a-abee9610a03a tempest-GroupSnapshotsV319Test-1513661982 None] Created reservations ['f60856a8-f7e5-4bf3-8a37-f77ca8b5f33b'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:32:05 devstack cinder-volume[82800]: WARNING cinder.quota [None req-3ca70d41-9923-4bd6-a08a-abee9610a03a tempest-GroupSnapshotsV319Test-1513661982 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-450489903 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-450489903, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:32:05 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-3ca70d41-9923-4bd6-a08a-abee9610a03a tempest-GroupSnapshotsV319Test-1513661982 None] Created reservations ['e0cfc561-cf2d-485a-aac5-0c0ffe0e87f8', 'bc00d5f5-4c7d-4d8e-968d-16ee17cf71d0', 'bfc55776-5081-4691-a199-9133909859d7', '3e620617-3c15-4a76-8ed7-d39484833e86'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:32:05 devstack quobyte-client[82814]: System call of process 91365 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:32:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-35b149d7-6fcb-4008-9ec9-70736288bf44 tempest-AttachVolumeShelveTestJSON-83004131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-fac56de2-07b7-4af9-989b-d733c463c29e" returned: 0 in 0.765s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-35b149d7-6fcb-4008-9ec9-70736288bf44 tempest-AttachVolumeShelveTestJSON-83004131 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-fac56de2-07b7-4af9-989b-d733c463c29e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-35b149d7-6fcb-4008-9ec9-70736288bf44 tempest-AttachVolumeShelveTestJSON-83004131 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-fac56de2-07b7-4af9-989b-d733c463c29e" returned: 0 in 0.222s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:06 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-35b149d7-6fcb-4008-9ec9-70736288bf44 tempest-AttachVolumeShelveTestJSON-83004131 None] Lock "cinder-quobyte-fac56de2-07b7-4af9-989b-d733c463c29e" released by "delete_volume" :: held 1.279s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:32:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-3ca70d41-9923-4bd6-a08a-abee9610a03a tempest-GroupSnapshotsV319Test-1513661982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:32:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-3ca70d41-9923-4bd6-a08a-abee9610a03a tempest-GroupSnapshotsV319Test-1513661982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:32:06 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-3ca70d41-9923-4bd6-a08a-abee9610a03a tempest-GroupSnapshotsV319Test-1513661982 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:32:06 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-3ca70d41-9923-4bd6-a08a-abee9610a03a tempest-GroupSnapshotsV319Test-1513661982 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:32:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-3ca70d41-9923-4bd6-a08a-abee9610a03a tempest-GroupSnapshotsV319Test-1513661982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:32:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3ca70d41-9923-4bd6-a08a-abee9610a03a tempest-GroupSnapshotsV319Test-1513661982 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3ca70d41-9923-4bd6-a08a-abee9610a03a tempest-GroupSnapshotsV319Test-1513661982 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.354s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:06 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-3ca70d41-9923-4bd6-a08a-abee9610a03a tempest-GroupSnapshotsV319Test-1513661982 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:32:06 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-3ca70d41-9923-4bd6-a08a-abee9610a03a tempest-GroupSnapshotsV319Test-1513661982 None] Delete group completed successfully. Sep 10 15:32:06 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-35b149d7-6fcb-4008-9ec9-70736288bf44 tempest-AttachVolumeShelveTestJSON-83004131 None] Created reservations ['8737e50d-8cc2-4d57-9df0-9dbc76c886a5', '8d2494c6-20f3-4a22-8f8c-e3c87488e280', '548c7336-b0ba-4c8b-a015-cd26ecccc003', 'dc26fd87-d63d-419b-af5b-10175a6b06ac'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:32:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-35b149d7-6fcb-4008-9ec9-70736288bf44 tempest-AttachVolumeShelveTestJSON-83004131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:32:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-35b149d7-6fcb-4008-9ec9-70736288bf44 tempest-AttachVolumeShelveTestJSON-83004131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:32:06 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-35b149d7-6fcb-4008-9ec9-70736288bf44 tempest-AttachVolumeShelveTestJSON-83004131 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:32:06 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-35b149d7-6fcb-4008-9ec9-70736288bf44 tempest-AttachVolumeShelveTestJSON-83004131 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:32:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-35b149d7-6fcb-4008-9ec9-70736288bf44 tempest-AttachVolumeShelveTestJSON-83004131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:32:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-35b149d7-6fcb-4008-9ec9-70736288bf44 tempest-AttachVolumeShelveTestJSON-83004131 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-35b149d7-6fcb-4008-9ec9-70736288bf44 tempest-AttachVolumeShelveTestJSON-83004131 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.176s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:07 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-35b149d7-6fcb-4008-9ec9-70736288bf44 tempest-AttachVolumeShelveTestJSON-83004131 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:32:07 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-35b149d7-6fcb-4008-9ec9-70736288bf44 tempest-AttachVolumeShelveTestJSON-83004131 None] Deleted volume successfully. Sep 10 15:32:07 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-35b149d7-6fcb-4008-9ec9-70736288bf44 tempest-AttachVolumeShelveTestJSON-83004131 None] Lock "cinder-fac56de2-07b7-4af9-989b-d733c463c29e-delete_volume" released by "delete_volume" :: held 3.317s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:32:07 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-f6e827d0-5d90-4ad4-9ad3-3b931533b7c3 tempest-AttachVolumeShelveTestJSON-83004131 None] Acquiring lock "cinder-86dcba84-d86a-4366-8ca5-8b190dabfd13-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:32:07 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-f6e827d0-5d90-4ad4-9ad3-3b931533b7c3 tempest-AttachVolumeShelveTestJSON-83004131 None] Lock "cinder-86dcba84-d86a-4366-8ca5-8b190dabfd13-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:32:07 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-f6e827d0-5d90-4ad4-9ad3-3b931533b7c3 tempest-AttachVolumeShelveTestJSON-83004131 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:32:07 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-f6e827d0-5d90-4ad4-9ad3-3b931533b7c3 tempest-AttachVolumeShelveTestJSON-83004131 None] Acquiring lock "cinder-quobyte-86dcba84-d86a-4366-8ca5-8b190dabfd13" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:32:07 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-f6e827d0-5d90-4ad4-9ad3-3b931533b7c3 tempest-AttachVolumeShelveTestJSON-83004131 None] Lock "cinder-quobyte-86dcba84-d86a-4366-8ca5-8b190dabfd13" acquired by "delete_volume" :: waited 0.013s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:32:07 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a82fc4-cb90-44d7-af4a-1916a5290a61]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:32:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f6e827d0-5d90-4ad4-9ad3-3b931533b7c3 tempest-AttachVolumeShelveTestJSON-83004131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86dcba84-d86a-4366-8ca5-8b190dabfd13 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f6e827d0-5d90-4ad4-9ad3-3b931533b7c3 tempest-AttachVolumeShelveTestJSON-83004131 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86dcba84-d86a-4366-8ca5-8b190dabfd13" returned: 0 in 0.560s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f6e827d0-5d90-4ad4-9ad3-3b931533b7c3 tempest-AttachVolumeShelveTestJSON-83004131 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86dcba84-d86a-4366-8ca5-8b190dabfd13 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f6e827d0-5d90-4ad4-9ad3-3b931533b7c3 tempest-AttachVolumeShelveTestJSON-83004131 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86dcba84-d86a-4366-8ca5-8b190dabfd13" returned: 0 in 0.117s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:08 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-f6e827d0-5d90-4ad4-9ad3-3b931533b7c3 tempest-AttachVolumeShelveTestJSON-83004131 None] Lock "cinder-quobyte-86dcba84-d86a-4366-8ca5-8b190dabfd13" released by "delete_volume" :: held 0.865s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:32:09 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-f6e827d0-5d90-4ad4-9ad3-3b931533b7c3 tempest-AttachVolumeShelveTestJSON-83004131 None] Created reservations ['d21dbe49-a856-47cc-9d7b-42bf53f45dc4', 'b63bf36e-4f63-40a9-bf5e-122356129d37', '62ea1acc-b1dd-434f-9063-56ee34ab00de', 'fc642bb2-97ea-407d-b87c-2441ad468235'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:32:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f6e827d0-5d90-4ad4-9ad3-3b931533b7c3 tempest-AttachVolumeShelveTestJSON-83004131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:32:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f6e827d0-5d90-4ad4-9ad3-3b931533b7c3 tempest-AttachVolumeShelveTestJSON-83004131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:32:09 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f6e827d0-5d90-4ad4-9ad3-3b931533b7c3 tempest-AttachVolumeShelveTestJSON-83004131 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:32:09 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f6e827d0-5d90-4ad4-9ad3-3b931533b7c3 tempest-AttachVolumeShelveTestJSON-83004131 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:32:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f6e827d0-5d90-4ad4-9ad3-3b931533b7c3 tempest-AttachVolumeShelveTestJSON-83004131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:32:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f6e827d0-5d90-4ad4-9ad3-3b931533b7c3 tempest-AttachVolumeShelveTestJSON-83004131 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f6e827d0-5d90-4ad4-9ad3-3b931533b7c3 tempest-AttachVolumeShelveTestJSON-83004131 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.144s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:09 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-f6e827d0-5d90-4ad4-9ad3-3b931533b7c3 tempest-AttachVolumeShelveTestJSON-83004131 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:32:09 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-f6e827d0-5d90-4ad4-9ad3-3b931533b7c3 tempest-AttachVolumeShelveTestJSON-83004131 None] Deleted volume successfully. Sep 10 15:32:09 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-f6e827d0-5d90-4ad4-9ad3-3b931533b7c3 tempest-AttachVolumeShelveTestJSON-83004131 None] Lock "cinder-86dcba84-d86a-4366-8ca5-8b190dabfd13-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:32:19 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=42,cinder:UPDATE=40,cinder:DELETE=1,cinder:INSERT=9 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:32:19 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=38,cinder:UPDATE=42,cinder:INSERT=9,cinder:DELETE=2 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:32:27 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-bad6ea61-f68d-4f4d-b365-3f535ec8b573 tempest-GroupsTest-1827460086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:32:27 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-bad6ea61-f68d-4f4d-b365-3f535ec8b573 tempest-GroupsTest-1827460086 None] Group tempest-Group1-2034021998: creating Sep 10 15:32:27 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-bad6ea61-f68d-4f4d-b365-3f535ec8b573 tempest-GroupsTest-1827460086 None] Group tempest-Group1-2034021998: created successfully Sep 10 15:32:27 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-bad6ea61-f68d-4f4d-b365-3f535ec8b573 tempest-GroupsTest-1827460086 None] Create group completed successfully. Sep 10 15:32:28 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:32:28 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:32:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Flow 'volume_create_manager' (4c0e54c5-3249-420b-a5fe-f1f44120347b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:32:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9cf7490-c19e-4344-bb05-1a9c4f73fcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9cf7490-c19e-4344-bb05-1a9c4f73fcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-160482530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e4c744d-55e7-4d78-9cf5-e7a1df25dd9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13e688b1289b41a29cebb00cabfb0fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:32:28Z,use_quota=True,user_id='b59e4ba40a1b475a943d47be8626a732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f115676-0072-4089-ba4e-3063d95aaebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f115676-0072-4089-ba4e-3063d95aaebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca577f1-d204-4591-a8ce-58fb7b4ac152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca577f1-d204-4591-a8ce-58fb7b4ac152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e4c744d-55e7-4d78-9cf5-e7a1df25dd9e', 'volume_name': 'volume-2e4c744d-55e7-4d78-9cf5-e7a1df25dd9e', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a0e40c-f031-4b27-9dbc-e66e2b324786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a0e40c-f031-4b27-9dbc-e66e2b324786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec14ca2-8465-497e-9992-fbdf62eb3b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:28 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Volume 2e4c744d-55e7-4d78-9cf5-e7a1df25dd9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e4c744d-55e7-4d78-9cf5-e7a1df25dd9e', 'volume_size': 1} Sep 10 15:32:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:32:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:32:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-160482530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e4c744d-55e7-4d78-9cf5-e7a1df25dd9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13e688b1289b41a29cebb00cabfb0fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:32:28Z,use_quota=True,user_id='b59e4ba40a1b475a943d47be8626a732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:32:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Creating volume 2e4c744d-55e7-4d78-9cf5-e7a1df25dd9e {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:32:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:32:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:32:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:32:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:32:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:32:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:32:28 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:32:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2e4c744d-55e7-4d78-9cf5-e7a1df25dd9e 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:28 devstack quobyte-client[82814]: System call of process 91419 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:32:28 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=39, name=volume-2e4c744d-55e7-4d78-9cf5-e7a1df25dd9e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:32:28 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-e4651b08-66ce-495c-bdc8-887fed81a762 tempest-GroupsTest-1827460086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:32:28 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-e4651b08-66ce-495c-bdc8-887fed81a762 tempest-GroupsTest-1827460086 None] Group tempest-Group2-735124858: creating Sep 10 15:32:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:32:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:32:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:32:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:32:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:32:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:32:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2e4c744d-55e7-4d78-9cf5-e7a1df25dd9e 1073741824" returned: 0 in 1.204s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2e4c744d-55e7-4d78-9cf5-e7a1df25dd9e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2e4c744d-55e7-4d78-9cf5-e7a1df25dd9e" returned: 0 in 0.334s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.712s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] <== create_volume: return (1603ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:32:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:32:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:32:30 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-e4651b08-66ce-495c-bdc8-887fed81a762 tempest-GroupsTest-1827460086 None] Group tempest-Group2-735124858: created successfully Sep 10 15:32:30 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ec14ca2-8465-497e-9992-fbdf62eb3b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e4c744d-55e7-4d78-9cf5-e7a1df25dd9e', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:30 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86420f3b-2d1a-452d-bbb3-d230915ae0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:30 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Volume volume-2e4c744d-55e7-4d78-9cf5-e7a1df25dd9e (2e4c744d-55e7-4d78-9cf5-e7a1df25dd9e): created successfully Sep 10 15:32:30 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86420f3b-2d1a-452d-bbb3-d230915ae0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:30 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Flow 'volume_create_manager' (4c0e54c5-3249-420b-a5fe-f1f44120347b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:32:30 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-e4651b08-66ce-495c-bdc8-887fed81a762 tempest-GroupsTest-1827460086 None] Create group completed successfully. Sep 10 15:32:30 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-186fdde2-0dfd-4847-a097-e7c7f67bf40b tempest-VolumeQuotasAdminTestJSON-1925334237 None] Created volume successfully. Sep 10 15:32:30 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b552492b-df40-4ab4-995f-e17a26a481b6 tempest-VolumeQuotasAdminTestJSON-1925334237 None] Acquiring lock "cinder-2e4c744d-55e7-4d78-9cf5-e7a1df25dd9e-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:32:30 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b552492b-df40-4ab4-995f-e17a26a481b6 tempest-VolumeQuotasAdminTestJSON-1925334237 None] Lock "cinder-2e4c744d-55e7-4d78-9cf5-e7a1df25dd9e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:32:30 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-b552492b-df40-4ab4-995f-e17a26a481b6 tempest-VolumeQuotasAdminTestJSON-1925334237 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:32:30 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b552492b-df40-4ab4-995f-e17a26a481b6 tempest-VolumeQuotasAdminTestJSON-1925334237 None] Acquiring lock "cinder-quobyte-2e4c744d-55e7-4d78-9cf5-e7a1df25dd9e" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:32:30 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b552492b-df40-4ab4-995f-e17a26a481b6 tempest-VolumeQuotasAdminTestJSON-1925334237 None] Lock "cinder-quobyte-2e4c744d-55e7-4d78-9cf5-e7a1df25dd9e" acquired by "delete_volume" :: waited 0.025s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:32:30 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b588393-5861-41f2-a474-d9adf26fe63d]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:32:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b552492b-df40-4ab4-995f-e17a26a481b6 tempest-VolumeQuotasAdminTestJSON-1925334237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2e4c744d-55e7-4d78-9cf5-e7a1df25dd9e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b552492b-df40-4ab4-995f-e17a26a481b6 tempest-VolumeQuotasAdminTestJSON-1925334237 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2e4c744d-55e7-4d78-9cf5-e7a1df25dd9e" returned: 0 in 0.622s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b552492b-df40-4ab4-995f-e17a26a481b6 tempest-VolumeQuotasAdminTestJSON-1925334237 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2e4c744d-55e7-4d78-9cf5-e7a1df25dd9e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b552492b-df40-4ab4-995f-e17a26a481b6 tempest-VolumeQuotasAdminTestJSON-1925334237 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2e4c744d-55e7-4d78-9cf5-e7a1df25dd9e" returned: 0 in 0.406s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:31 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b552492b-df40-4ab4-995f-e17a26a481b6 tempest-VolumeQuotasAdminTestJSON-1925334237 None] Lock "cinder-quobyte-2e4c744d-55e7-4d78-9cf5-e7a1df25dd9e" released by "delete_volume" :: held 1.239s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:32:31 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:32:31 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:32:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Flow 'volume_create_manager' (2a8bce7e-0eab-43ea-ad86-24f668da3a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:32:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add402ee-670a-465d-b3f5-f993f1e719e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add402ee-670a-465d-b3f5-f993f1e719e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1188401050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=21844485-c118-4dc5-a228-6368ff0b9cf6,host='devstack@QuobyteHD#QuobyteHD',id=44a5af7c-f102-4120-96fd-8aead74fded0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad5d8d646eb54ccbbf0ea4da3c6d2297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:32:31Z,use_quota=True,user_id='df11453464104e209b6f703486b60253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ccc8ff7-66d1-4c5d-b833-404060a920c1),volume_type_id=4ccc8ff7-66d1-4c5d-b833-404060a920c1)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d53e15b6-7385-429a-955d-7e8c14078273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d53e15b6-7385-429a-955d-7e8c14078273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c08a0fa6-b4a7-40e3-8002-886f10db4769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c08a0fa6-b4a7-40e3-8002-886f10db4769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44a5af7c-f102-4120-96fd-8aead74fded0', 'volume_name': 'volume-44a5af7c-f102-4120-96fd-8aead74fded0', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8791f6-953d-473e-8542-d4384d68d23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8791f6-953d-473e-8542-d4384d68d23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (819a780b-2cbc-4c0a-8fd1-abfe2a14991a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:32 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Volume 44a5af7c-f102-4120-96fd-8aead74fded0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44a5af7c-f102-4120-96fd-8aead74fded0', 'volume_size': 1} Sep 10 15:32:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:32:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:32:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=21844485-c118-4dc5-a228-6368ff0b9cf6,created_at=2025-09-10T13:32:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1188401050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=21844485-c118-4dc5-a228-6368ff0b9cf6,host='devstack@QuobyteHD#QuobyteHD',id=44a5af7c-f102-4120-96fd-8aead74fded0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad5d8d646eb54ccbbf0ea4da3c6d2297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:32:31Z,use_quota=True,user_id='df11453464104e209b6f703486b60253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ccc8ff7-66d1-4c5d-b833-404060a920c1),volume_type_id=4ccc8ff7-66d1-4c5d-b833-404060a920c1)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:32:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Creating volume 44a5af7c-f102-4120-96fd-8aead74fded0 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:32:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:32:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:32:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:32:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:32:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:32:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:32:32 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:32:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-44a5af7c-f102-4120-96fd-8aead74fded0 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:32 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=40, name=volume-44a5af7c-f102-4120-96fd-8aead74fded0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:32:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-44a5af7c-f102-4120-96fd-8aead74fded0 1073741824" returned: 0 in 0.610s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-44a5af7c-f102-4120-96fd-8aead74fded0 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-44a5af7c-f102-4120-96fd-8aead74fded0" returned: 0 in 0.211s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:33 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] <== create_volume: return (879ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:32:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:32:33 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-b552492b-df40-4ab4-995f-e17a26a481b6 tempest-VolumeQuotasAdminTestJSON-1925334237 None] Created reservations ['bca16344-d031-44dd-8cf6-cd4ac8668e02', '910af803-ac87-43f7-87e0-682f061a9d56', '76b444e1-3e9b-4cb0-86c0-34c349da2cc9', 'dbd7e3a8-022c-4395-8199-f970662bce15'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:32:33 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (819a780b-2cbc-4c0a-8fd1-abfe2a14991a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44a5af7c-f102-4120-96fd-8aead74fded0', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:33 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72836871-13fa-4bfe-9860-2dc8e2649bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:33 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Volume volume-44a5af7c-f102-4120-96fd-8aead74fded0 (44a5af7c-f102-4120-96fd-8aead74fded0): created successfully Sep 10 15:32:33 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72836871-13fa-4bfe-9860-2dc8e2649bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:33 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Flow 'volume_create_manager' (2a8bce7e-0eab-43ea-ad86-24f668da3a9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:32:33 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-45027d5f-0d08-4b6d-b6fb-7626780f5594 tempest-GroupsTest-1827460086 None] Created volume successfully. Sep 10 15:32:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b552492b-df40-4ab4-995f-e17a26a481b6 tempest-VolumeQuotasAdminTestJSON-1925334237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:32:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b552492b-df40-4ab4-995f-e17a26a481b6 tempest-VolumeQuotasAdminTestJSON-1925334237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:32:33 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b552492b-df40-4ab4-995f-e17a26a481b6 tempest-VolumeQuotasAdminTestJSON-1925334237 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:32:33 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b552492b-df40-4ab4-995f-e17a26a481b6 tempest-VolumeQuotasAdminTestJSON-1925334237 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:32:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b552492b-df40-4ab4-995f-e17a26a481b6 tempest-VolumeQuotasAdminTestJSON-1925334237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:32:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b552492b-df40-4ab4-995f-e17a26a481b6 tempest-VolumeQuotasAdminTestJSON-1925334237 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b552492b-df40-4ab4-995f-e17a26a481b6 tempest-VolumeQuotasAdminTestJSON-1925334237 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.156s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:33 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-b552492b-df40-4ab4-995f-e17a26a481b6 tempest-VolumeQuotasAdminTestJSON-1925334237 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:32:33 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-b552492b-df40-4ab4-995f-e17a26a481b6 tempest-VolumeQuotasAdminTestJSON-1925334237 None] Deleted volume successfully. Sep 10 15:32:34 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b552492b-df40-4ab4-995f-e17a26a481b6 tempest-VolumeQuotasAdminTestJSON-1925334237 None] Lock "cinder-2e4c744d-55e7-4d78-9cf5-e7a1df25dd9e-delete_volume" released by "delete_volume" :: held 3.849s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:32:34 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-147e2fb4-f1d0-4f44-8c2e-d8ac3a3b461a tempest-GroupsTest-1827460086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:32:34 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-147e2fb4-f1d0-4f44-8c2e-d8ac3a3b461a tempest-GroupsTest-1827460086 None] Acquiring lock "cinder-quobyte-44a5af7c-f102-4120-96fd-8aead74fded0" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:32:34 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:32:35 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:32:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Flow 'volume_create_manager' (a1dfce59-477c-465f-821a-7c7f7ad64981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:32:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7045b6c-2fe7-49dd-bc20-6415c0714b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:35 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-147e2fb4-f1d0-4f44-8c2e-d8ac3a3b461a tempest-GroupsTest-1827460086 None] Lock "cinder-quobyte-44a5af7c-f102-4120-96fd-8aead74fded0" acquired by "delete_volume" :: waited 0.181s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:32:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7045b6c-2fe7-49dd-bc20-6415c0714b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1280215773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f49e680-508d-43f6-80af-3228d87f42a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13e688b1289b41a29cebb00cabfb0fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:32:35Z,use_quota=True,user_id='b59e4ba40a1b475a943d47be8626a732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01f20fe-49e8-466a-bbc7-39ec3bbc2a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01f20fe-49e8-466a-bbc7-39ec3bbc2a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa82580-cfec-4fe5-b6d1-02178c79ed71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa82580-cfec-4fe5-b6d1-02178c79ed71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f49e680-508d-43f6-80af-3228d87f42a0', 'volume_name': 'volume-9f49e680-508d-43f6-80af-3228d87f42a0', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e6ec03c-9543-4b46-97ff-c7f8022b3cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e6ec03c-9543-4b46-97ff-c7f8022b3cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81dbe545-1bd1-4cdf-be87-ae5437a830ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:35 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Volume 9f49e680-508d-43f6-80af-3228d87f42a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f49e680-508d-43f6-80af-3228d87f42a0', 'volume_size': 1} Sep 10 15:32:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:32:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:32:35 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1280215773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f49e680-508d-43f6-80af-3228d87f42a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13e688b1289b41a29cebb00cabfb0fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:32:35Z,use_quota=True,user_id='b59e4ba40a1b475a943d47be8626a732',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:32:35 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Creating volume 9f49e680-508d-43f6-80af-3228d87f42a0 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:32:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:32:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:32:35 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:32:35 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:32:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:32:35 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:32:35 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:32:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9f49e680-508d-43f6-80af-3228d87f42a0 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:35 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[8430f850-0faa-4c39-b1a0-d8e438604681]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:32:35 devstack quobyte-client[82814]: System call of process 91434 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:32:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-147e2fb4-f1d0-4f44-8c2e-d8ac3a3b461a tempest-GroupsTest-1827460086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-44a5af7c-f102-4120-96fd-8aead74fded0 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:35 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=41, name=volume-9f49e680-508d-43f6-80af-3228d87f42a0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:32:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9f49e680-508d-43f6-80af-3228d87f42a0 1073741824" returned: 0 in 0.536s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9f49e680-508d-43f6-80af-3228d87f42a0 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9f49e680-508d-43f6-80af-3228d87f42a0" returned: 0 in 0.183s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:36 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] <== create_volume: return (830ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:32:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:32:36 devstack quobyte-client[82814]: System call of process 91437 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:32:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-147e2fb4-f1d0-4f44-8c2e-d8ac3a3b461a tempest-GroupsTest-1827460086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-44a5af7c-f102-4120-96fd-8aead74fded0" returned: 0 in 0.859s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-147e2fb4-f1d0-4f44-8c2e-d8ac3a3b461a tempest-GroupsTest-1827460086 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-44a5af7c-f102-4120-96fd-8aead74fded0 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-147e2fb4-f1d0-4f44-8c2e-d8ac3a3b461a tempest-GroupsTest-1827460086 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-44a5af7c-f102-4120-96fd-8aead74fded0" returned: 0 in 0.172s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81dbe545-1bd1-4cdf-be87-ae5437a830ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f49e680-508d-43f6-80af-3228d87f42a0', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e173db7b-4162-405b-8044-3d52f4e78fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:36 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-147e2fb4-f1d0-4f44-8c2e-d8ac3a3b461a tempest-GroupsTest-1827460086 None] Lock "cinder-quobyte-44a5af7c-f102-4120-96fd-8aead74fded0" released by "delete_volume" :: held 1.532s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:32:36 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Volume volume-9f49e680-508d-43f6-80af-3228d87f42a0 (9f49e680-508d-43f6-80af-3228d87f42a0): created successfully Sep 10 15:32:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e173db7b-4162-405b-8044-3d52f4e78fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Flow 'volume_create_manager' (a1dfce59-477c-465f-821a-7c7f7ad64981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:32:36 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-d8571272-af74-458e-90dc-173e8c3371da tempest-VolumeQuotasAdminTestJSON-1925334237 None] Created volume successfully. Sep 10 15:32:37 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-147e2fb4-f1d0-4f44-8c2e-d8ac3a3b461a tempest-GroupsTest-1827460086 None] Created reservations ['3480c984-4cad-4825-99ac-811119ecbf75'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:32:37 devstack cinder-volume[82800]: WARNING cinder.quota [None req-147e2fb4-f1d0-4f44-8c2e-d8ac3a3b461a tempest-GroupsTest-1827460086 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-468578571 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-468578571, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:32:37 devstack cinder-volume[82800]: WARNING cinder.quota [None req-147e2fb4-f1d0-4f44-8c2e-d8ac3a3b461a tempest-GroupsTest-1827460086 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-468578571 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-468578571, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:32:37 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-147e2fb4-f1d0-4f44-8c2e-d8ac3a3b461a tempest-GroupsTest-1827460086 None] Created reservations ['9ed0a996-0f07-4f21-947e-910817ad4761', '95f63e77-ca45-4e9c-a18e-e8957796f4b5', '800f3af5-d532-42f7-8f09-dd971db31658', '84eecd31-d1a8-4feb-8ca9-d8d750e6a67c'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:32:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-147e2fb4-f1d0-4f44-8c2e-d8ac3a3b461a tempest-GroupsTest-1827460086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:32:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-147e2fb4-f1d0-4f44-8c2e-d8ac3a3b461a tempest-GroupsTest-1827460086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:32:37 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-147e2fb4-f1d0-4f44-8c2e-d8ac3a3b461a tempest-GroupsTest-1827460086 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:32:37 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-147e2fb4-f1d0-4f44-8c2e-d8ac3a3b461a tempest-GroupsTest-1827460086 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:32:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-147e2fb4-f1d0-4f44-8c2e-d8ac3a3b461a tempest-GroupsTest-1827460086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:32:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-147e2fb4-f1d0-4f44-8c2e-d8ac3a3b461a tempest-GroupsTest-1827460086 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-147e2fb4-f1d0-4f44-8c2e-d8ac3a3b461a tempest-GroupsTest-1827460086 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.267s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:38 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-147e2fb4-f1d0-4f44-8c2e-d8ac3a3b461a tempest-GroupsTest-1827460086 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:32:38 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-147e2fb4-f1d0-4f44-8c2e-d8ac3a3b461a tempest-GroupsTest-1827460086 None] Delete group completed successfully. Sep 10 15:32:38 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-449ed4db-d3a1-4661-84cc-3e9392769fc6 tempest-VolumeQuotasAdminTestJSON-861482111 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:32:38 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-449ed4db-d3a1-4661-84cc-3e9392769fc6 tempest-VolumeQuotasAdminTestJSON-861482111 None] Transfer volume completed successfully. Sep 10 15:32:38 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-4031fbbc-62e0-4378-a959-7fa95a4d998c tempest-GroupsTest-1827460086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:32:38 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-4031fbbc-62e0-4378-a959-7fa95a4d998c tempest-GroupsTest-1827460086 None] Created reservations ['0e4eca47-898c-492a-b762-4fdf8da08944'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:32:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-4031fbbc-62e0-4378-a959-7fa95a4d998c tempest-GroupsTest-1827460086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:32:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-4031fbbc-62e0-4378-a959-7fa95a4d998c tempest-GroupsTest-1827460086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:32:39 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-4031fbbc-62e0-4378-a959-7fa95a4d998c tempest-GroupsTest-1827460086 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:32:39 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-4031fbbc-62e0-4378-a959-7fa95a4d998c tempest-GroupsTest-1827460086 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:32:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-4031fbbc-62e0-4378-a959-7fa95a4d998c tempest-GroupsTest-1827460086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:32:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4031fbbc-62e0-4378-a959-7fa95a4d998c tempest-GroupsTest-1827460086 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4031fbbc-62e0-4378-a959-7fa95a4d998c tempest-GroupsTest-1827460086 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.144s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:39 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-4031fbbc-62e0-4378-a959-7fa95a4d998c tempest-GroupsTest-1827460086 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:32:39 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-4031fbbc-62e0-4378-a959-7fa95a4d998c tempest-GroupsTest-1827460086 None] Delete group completed successfully. Sep 10 15:32:40 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c74e41fb-9336-4cca-b84a-5fb103ae0e6d tempest-VolumeQuotasAdminTestJSON-2027762779 None] Acquiring lock "cinder-9f49e680-508d-43f6-80af-3228d87f42a0-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:32:40 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c74e41fb-9336-4cca-b84a-5fb103ae0e6d tempest-VolumeQuotasAdminTestJSON-2027762779 None] Lock "cinder-9f49e680-508d-43f6-80af-3228d87f42a0-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:32:40 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-c74e41fb-9336-4cca-b84a-5fb103ae0e6d tempest-VolumeQuotasAdminTestJSON-2027762779 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:32:40 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c74e41fb-9336-4cca-b84a-5fb103ae0e6d tempest-VolumeQuotasAdminTestJSON-2027762779 None] Acquiring lock "cinder-quobyte-9f49e680-508d-43f6-80af-3228d87f42a0" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:32:40 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c74e41fb-9336-4cca-b84a-5fb103ae0e6d tempest-VolumeQuotasAdminTestJSON-2027762779 None] Lock "cinder-quobyte-9f49e680-508d-43f6-80af-3228d87f42a0" acquired by "delete_volume" :: waited 0.013s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:32:40 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d04083d-271b-40a4-85ba-59e9d368deb0]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:32:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c74e41fb-9336-4cca-b84a-5fb103ae0e6d tempest-VolumeQuotasAdminTestJSON-2027762779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9f49e680-508d-43f6-80af-3228d87f42a0 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:41 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-f3d91994-f878-4a37-acd7-133fb783b3a3 tempest-GroupsTest-1827460086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:32:41 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-f3d91994-f878-4a37-acd7-133fb783b3a3 tempest-GroupsTest-1827460086 None] Group tempest-GroupsTest-Group-1455708937: creating Sep 10 15:32:41 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-f3d91994-f878-4a37-acd7-133fb783b3a3 tempest-GroupsTest-1827460086 None] Group tempest-GroupsTest-Group-1455708937: created successfully Sep 10 15:32:41 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-f3d91994-f878-4a37-acd7-133fb783b3a3 tempest-GroupsTest-1827460086 None] Create group completed successfully. Sep 10 15:32:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c74e41fb-9336-4cca-b84a-5fb103ae0e6d tempest-VolumeQuotasAdminTestJSON-2027762779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9f49e680-508d-43f6-80af-3228d87f42a0" returned: 0 in 0.725s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c74e41fb-9336-4cca-b84a-5fb103ae0e6d tempest-VolumeQuotasAdminTestJSON-2027762779 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9f49e680-508d-43f6-80af-3228d87f42a0 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c74e41fb-9336-4cca-b84a-5fb103ae0e6d tempest-VolumeQuotasAdminTestJSON-2027762779 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9f49e680-508d-43f6-80af-3228d87f42a0" returned: 0 in 0.134s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c74e41fb-9336-4cca-b84a-5fb103ae0e6d tempest-VolumeQuotasAdminTestJSON-2027762779 None] Lock "cinder-quobyte-9f49e680-508d-43f6-80af-3228d87f42a0" released by "delete_volume" :: held 1.006s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:32:41 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-c74e41fb-9336-4cca-b84a-5fb103ae0e6d tempest-VolumeQuotasAdminTestJSON-2027762779 None] Created reservations ['100ce78e-b17b-4b5c-873d-7457d571b990', '4678d015-6bfc-4315-bab5-69bca835da17', '30d0eda3-83d3-419f-b579-6b456dbbbe17', '82a2e74a-132e-4206-a1c6-dbc1e2eb5c83'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:32:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c74e41fb-9336-4cca-b84a-5fb103ae0e6d tempest-VolumeQuotasAdminTestJSON-2027762779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:32:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c74e41fb-9336-4cca-b84a-5fb103ae0e6d tempest-VolumeQuotasAdminTestJSON-2027762779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:32:41 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c74e41fb-9336-4cca-b84a-5fb103ae0e6d tempest-VolumeQuotasAdminTestJSON-2027762779 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:32:41 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c74e41fb-9336-4cca-b84a-5fb103ae0e6d tempest-VolumeQuotasAdminTestJSON-2027762779 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:32:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c74e41fb-9336-4cca-b84a-5fb103ae0e6d tempest-VolumeQuotasAdminTestJSON-2027762779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:32:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c74e41fb-9336-4cca-b84a-5fb103ae0e6d tempest-VolumeQuotasAdminTestJSON-2027762779 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c74e41fb-9336-4cca-b84a-5fb103ae0e6d tempest-VolumeQuotasAdminTestJSON-2027762779 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.158s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:42 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-c74e41fb-9336-4cca-b84a-5fb103ae0e6d tempest-VolumeQuotasAdminTestJSON-2027762779 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:32:42 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-c74e41fb-9336-4cca-b84a-5fb103ae0e6d tempest-VolumeQuotasAdminTestJSON-2027762779 None] Deleted volume successfully. Sep 10 15:32:42 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c74e41fb-9336-4cca-b84a-5fb103ae0e6d tempest-VolumeQuotasAdminTestJSON-2027762779 None] Lock "cinder-9f49e680-508d-43f6-80af-3228d87f42a0-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:32:42 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:32:42 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:32:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Flow 'volume_create_manager' (b6053f2e-3171-40e1-bc87-8b19777662c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:32:43 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (449ea6e8-0b6a-499d-a8aa-c6b6bcc088ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:43 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (449ea6e8-0b6a-499d-a8aa-c6b6bcc088ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1567352672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5940ecab-2745-4063-81e9-43193388db51,host='devstack@QuobyteHD#QuobyteHD',id=3e789213-f946-40eb-8462-eceffdba7bfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad5d8d646eb54ccbbf0ea4da3c6d2297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:32:43Z,use_quota=True,user_id='df11453464104e209b6f703486b60253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4825bad0-412a-4282-9988-0aedbac27df2),volume_type_id=4825bad0-412a-4282-9988-0aedbac27df2)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:43 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb44ebc5-e214-4317-a618-fb6f815b6c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:43 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb44ebc5-e214-4317-a618-fb6f815b6c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:43 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb9c10d2-6db3-43bd-9ea9-001182b1aa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:43 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb9c10d2-6db3-43bd-9ea9-001182b1aa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e789213-f946-40eb-8462-eceffdba7bfe', 'volume_name': 'volume-3e789213-f946-40eb-8462-eceffdba7bfe', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:43 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb78b38-cd71-4467-bb26-c23498d6f380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:43 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb78b38-cd71-4467-bb26-c23498d6f380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:43 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5673c0bd-8cc4-4bd4-b9e2-3ceb6f16c2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:43 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Volume 3e789213-f946-40eb-8462-eceffdba7bfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e789213-f946-40eb-8462-eceffdba7bfe', 'volume_size': 1} Sep 10 15:32:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:32:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:32:43 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5940ecab-2745-4063-81e9-43193388db51,created_at=2025-09-10T13:32:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1567352672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5940ecab-2745-4063-81e9-43193388db51,host='devstack@QuobyteHD#QuobyteHD',id=3e789213-f946-40eb-8462-eceffdba7bfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad5d8d646eb54ccbbf0ea4da3c6d2297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:32:43Z,use_quota=True,user_id='df11453464104e209b6f703486b60253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4825bad0-412a-4282-9988-0aedbac27df2),volume_type_id=4825bad0-412a-4282-9988-0aedbac27df2)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:32:43 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Creating volume 3e789213-f946-40eb-8462-eceffdba7bfe {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:32:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:32:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:32:43 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:32:43 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:32:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:32:43 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:32:43 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:32:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3e789213-f946-40eb-8462-eceffdba7bfe 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:43 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=42, name=volume-3e789213-f946-40eb-8462-eceffdba7bfe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:32:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3e789213-f946-40eb-8462-eceffdba7bfe 1073741824" returned: 0 in 0.495s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3e789213-f946-40eb-8462-eceffdba7bfe {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3e789213-f946-40eb-8462-eceffdba7bfe" returned: 0 in 0.222s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:43 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] <== create_volume: return (824ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:32:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:32:44 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5673c0bd-8cc4-4bd4-b9e2-3ceb6f16c2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e789213-f946-40eb-8462-eceffdba7bfe', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:44 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea792e3-5929-4f65-b14d-b3872b6d0fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:44 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Volume volume-3e789213-f946-40eb-8462-eceffdba7bfe (3e789213-f946-40eb-8462-eceffdba7bfe): created successfully Sep 10 15:32:44 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea792e3-5929-4f65-b14d-b3872b6d0fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:44 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Flow 'volume_create_manager' (b6053f2e-3171-40e1-bc87-8b19777662c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:32:44 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-67d191a8-9264-45c8-9f5d-9a189bd00c8d tempest-GroupsTest-1827460086 None] Created volume successfully. Sep 10 15:32:45 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:32:45 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:32:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Flow 'volume_create_manager' (431896d9-5f8d-493b-afaa-6aeb61b00d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:32:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2133c0c-1bab-48c5-b11f-5fdea554a76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2133c0c-1bab-48c5-b11f-5fdea554a76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1305587082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5940ecab-2745-4063-81e9-43193388db51,host='devstack@QuobyteHD#QuobyteHD',id=ddc49a3c-176a-430f-b600-5f5b5300bc22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad5d8d646eb54ccbbf0ea4da3c6d2297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:32:46Z,use_quota=True,user_id='df11453464104e209b6f703486b60253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4825bad0-412a-4282-9988-0aedbac27df2),volume_type_id=4825bad0-412a-4282-9988-0aedbac27df2)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cabf7067-7c7e-4558-8045-3e05b67fe46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cabf7067-7c7e-4558-8045-3e05b67fe46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db5bb5d-b6e7-4b4a-a0d0-d1255cd36982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db5bb5d-b6e7-4b4a-a0d0-d1255cd36982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddc49a3c-176a-430f-b600-5f5b5300bc22', 'volume_name': 'volume-ddc49a3c-176a-430f-b600-5f5b5300bc22', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a0452c-b2e9-4f5f-8307-866aa0b49a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a0452c-b2e9-4f5f-8307-866aa0b49a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6856573b-1c4c-474d-a710-3ea5ff29ab95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:46 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Volume ddc49a3c-176a-430f-b600-5f5b5300bc22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddc49a3c-176a-430f-b600-5f5b5300bc22', 'volume_size': 1} Sep 10 15:32:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:32:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:32:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5940ecab-2745-4063-81e9-43193388db51,created_at=2025-09-10T13:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1305587082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5940ecab-2745-4063-81e9-43193388db51,host='devstack@QuobyteHD#QuobyteHD',id=ddc49a3c-176a-430f-b600-5f5b5300bc22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad5d8d646eb54ccbbf0ea4da3c6d2297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:32:46Z,use_quota=True,user_id='df11453464104e209b6f703486b60253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4825bad0-412a-4282-9988-0aedbac27df2),volume_type_id=4825bad0-412a-4282-9988-0aedbac27df2)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:32:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Creating volume ddc49a3c-176a-430f-b600-5f5b5300bc22 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:32:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:32:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:32:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:32:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:32:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:32:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:32:46 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:32:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ddc49a3c-176a-430f-b600-5f5b5300bc22 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:46 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=43, name=volume-ddc49a3c-176a-430f-b600-5f5b5300bc22, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:32:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ddc49a3c-176a-430f-b600-5f5b5300bc22 1073741824" returned: 0 in 0.403s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ddc49a3c-176a-430f-b600-5f5b5300bc22 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ddc49a3c-176a-430f-b600-5f5b5300bc22" returned: 0 in 0.132s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] <== create_volume: return (611ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:32:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.634s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:32:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6856573b-1c4c-474d-a710-3ea5ff29ab95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddc49a3c-176a-430f-b600-5f5b5300bc22', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc3ca04-d5b3-4556-a6d7-d90f3bfa9f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:47 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Volume volume-ddc49a3c-176a-430f-b600-5f5b5300bc22 (ddc49a3c-176a-430f-b600-5f5b5300bc22): created successfully Sep 10 15:32:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc3ca04-d5b3-4556-a6d7-d90f3bfa9f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Flow 'volume_create_manager' (431896d9-5f8d-493b-afaa-6aeb61b00d6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:32:47 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-79e34e1c-9a3d-400d-9d87-3c945f7a9dee tempest-GroupsTest-1827460086 None] Created volume successfully. Sep 10 15:32:48 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-507e4cd6-728c-4904-9032-2f5b4da306e0 tempest-GroupsTest-1827460086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:32:48 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-507e4cd6-728c-4904-9032-2f5b4da306e0 tempest-GroupsTest-1827460086 None] Update group completed successfully. Sep 10 15:32:49 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-d4ac4abb-9789-4652-82f4-e3479406332c tempest-GroupsTest-1827460086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:32:49 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-d4ac4abb-9789-4652-82f4-e3479406332c tempest-GroupsTest-1827460086 None] Update group completed successfully. Sep 10 15:32:51 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:32:51 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] Acquiring lock "cinder-quobyte-3e789213-f946-40eb-8462-eceffdba7bfe" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:32:51 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] Lock "cinder-quobyte-3e789213-f946-40eb-8462-eceffdba7bfe" acquired by "delete_volume" :: waited 0.143s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:32:51 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ddec94-6d99-495a-8cab-f8a84f7ce7a5]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:32:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3e789213-f946-40eb-8462-eceffdba7bfe {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3e789213-f946-40eb-8462-eceffdba7bfe" returned: 0 in 0.616s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3e789213-f946-40eb-8462-eceffdba7bfe {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3e789213-f946-40eb-8462-eceffdba7bfe" returned: 0 in 0.155s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:52 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] Lock "cinder-quobyte-3e789213-f946-40eb-8462-eceffdba7bfe" released by "delete_volume" :: held 1.223s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:32:52 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] Acquiring lock "cinder-quobyte-ddc49a3c-176a-430f-b600-5f5b5300bc22" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:32:53 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] Lock "cinder-quobyte-ddc49a3c-176a-430f-b600-5f5b5300bc22" acquired by "delete_volume" :: waited 0.059s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:32:53 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39601c6-bbc8-4ce3-81b6-6dc2f2d9cdba]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:32:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ddc49a3c-176a-430f-b600-5f5b5300bc22 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ddc49a3c-176a-430f-b600-5f5b5300bc22" returned: 0 in 0.981s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ddc49a3c-176a-430f-b600-5f5b5300bc22 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ddc49a3c-176a-430f-b600-5f5b5300bc22" returned: 0 in 0.297s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] Lock "cinder-quobyte-ddc49a3c-176a-430f-b600-5f5b5300bc22" released by "delete_volume" :: held 1.747s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:32:55 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] Created reservations ['35a7012e-6036-4716-9335-f3cbcf45bebc'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:32:55 devstack cinder-volume[82800]: WARNING cinder.quota [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1910867756 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1910867756, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:32:55 devstack cinder-volume[82800]: WARNING cinder.quota [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1910867756 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1910867756, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:32:55 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] Created reservations ['f7c495de-99c8-41bc-96db-d8a48751d2d9', 'ac8bbe02-114c-41b0-8725-7d7959e3cbc4', '06e39603-609b-4154-bec7-81ce8628b666', 'aca9893c-67e3-4275-baf8-3ab7bf30f08d'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:32:56 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] Created reservations ['0e32425a-aa4c-437d-a0b4-6be0bd97971b', 'ad9d47c8-d910-448b-8fdd-a515f084fda1', '73d150c6-104f-4a93-811e-bc0b4446772d', '6daab367-c902-4e84-9e13-eb199797f7ba'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:32:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:32:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:32:56 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:32:56 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:32:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:32:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.197s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:56 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:32:57 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-c71d5fd9-1523-48dc-b40b-f597c906267a tempest-GroupsTest-1827460086 None] Delete group completed successfully. Sep 10 15:32:57 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:32:57 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:32:57 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Flow 'volume_create_manager' (856b4ebe-1d22-4862-88b0-747db17f8d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:32:57 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a373eb-3ec4-45de-8513-7337be2f7956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a373eb-3ec4-45de-8513-7337be2f7956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1006728589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d88cfa-998a-40d5-9ae0-822e814c9656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293d80a01c364c5789b3bc8e3ac03e30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:32:57Z,use_quota=True,user_id='b282116682c04be0bca5581520e1e8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b9f8e5c-4db4-438d-b1a3-8f7ebcae94ec),volume_type_id=1b9f8e5c-4db4-438d-b1a3-8f7ebcae94ec)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (323165a6-87c7-4762-b7a3-0576f2c7fc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (323165a6-87c7-4762-b7a3-0576f2c7fc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8cc69c-ccd6-4fc6-b155-ed62db608b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8cc69c-ccd6-4fc6-b155-ed62db608b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21d88cfa-998a-40d5-9ae0-822e814c9656', 'volume_name': 'volume-21d88cfa-998a-40d5-9ae0-822e814c9656', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (756c5bdd-adfe-4307-8129-3d5abe39fc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (756c5bdd-adfe-4307-8129-3d5abe39fc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ea13e6-0282-4322-a753-d16fc8e2d125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:58 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Volume 21d88cfa-998a-40d5-9ae0-822e814c9656: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21d88cfa-998a-40d5-9ae0-822e814c9656', 'volume_size': 1} Sep 10 15:32:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:32:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:32:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1006728589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21d88cfa-998a-40d5-9ae0-822e814c9656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293d80a01c364c5789b3bc8e3ac03e30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:32:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:32:57Z,use_quota=True,user_id='b282116682c04be0bca5581520e1e8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b9f8e5c-4db4-438d-b1a3-8f7ebcae94ec),volume_type_id=1b9f8e5c-4db4-438d-b1a3-8f7ebcae94ec)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:32:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Creating volume 21d88cfa-998a-40d5-9ae0-822e814c9656 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:32:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:32:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:32:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:32:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:32:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:32:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:32:58 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:32:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-21d88cfa-998a-40d5-9ae0-822e814c9656 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:58 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=44, name=volume-21d88cfa-998a-40d5-9ae0-822e814c9656, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:32:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-21d88cfa-998a-40d5-9ae0-822e814c9656 1073741824" returned: 0 in 0.564s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-21d88cfa-998a-40d5-9ae0-822e814c9656 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:32:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-21d88cfa-998a-40d5-9ae0-822e814c9656" returned: 0 in 0.285s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:32:59 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] <== create_volume: return (1037ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:32:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:32:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ea13e6-0282-4322-a753-d16fc8e2d125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21d88cfa-998a-40d5-9ae0-822e814c9656', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711cd15e-73ac-4bf3-a451-baa08e994f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:32:59 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Volume volume-21d88cfa-998a-40d5-9ae0-822e814c9656 (21d88cfa-998a-40d5-9ae0-822e814c9656): created successfully Sep 10 15:32:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711cd15e-73ac-4bf3-a451-baa08e994f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:32:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Flow 'volume_create_manager' (856b4ebe-1d22-4862-88b0-747db17f8d1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:32:59 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-fb640e4d-1511-4670-b9ee-cca0e6ee407f tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Created volume successfully. Sep 10 15:33:01 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-e3b7760a-2f59-44a3-a65d-a2ea1b4ef437 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:33:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e3b7760a-2f59-44a3-a65d-a2ea1b4ef437 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:33:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e3b7760a-2f59-44a3-a65d-a2ea1b4ef437 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:33:01 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e3b7760a-2f59-44a3-a65d-a2ea1b4ef437 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:33:01 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e3b7760a-2f59-44a3-a65d-a2ea1b4ef437 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:33:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e3b7760a-2f59-44a3-a65d-a2ea1b4ef437 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:33:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e3b7760a-2f59-44a3-a65d-a2ea1b4ef437 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e3b7760a-2f59-44a3-a65d-a2ea1b4ef437 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.142s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:01 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-e3b7760a-2f59-44a3-a65d-a2ea1b4ef437 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:33:01 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-e3b7760a-2f59-44a3-a65d-a2ea1b4ef437 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Retype volume completed successfully. Sep 10 15:33:02 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0ff2f5d4-6823-4985-ad3e-fa4afa6390b2 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Acquiring lock "cinder-21d88cfa-998a-40d5-9ae0-822e814c9656-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:33:02 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0ff2f5d4-6823-4985-ad3e-fa4afa6390b2 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Lock "cinder-21d88cfa-998a-40d5-9ae0-822e814c9656-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:33:03 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-0ff2f5d4-6823-4985-ad3e-fa4afa6390b2 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:33:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0ff2f5d4-6823-4985-ad3e-fa4afa6390b2 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Acquiring lock "cinder-quobyte-21d88cfa-998a-40d5-9ae0-822e814c9656" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:33:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0ff2f5d4-6823-4985-ad3e-fa4afa6390b2 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Lock "cinder-quobyte-21d88cfa-998a-40d5-9ae0-822e814c9656" acquired by "delete_volume" :: waited 0.036s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:33:03 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97fe0c0-0c47-434e-bff1-2daacd7c96d0]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:33:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0ff2f5d4-6823-4985-ad3e-fa4afa6390b2 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-21d88cfa-998a-40d5-9ae0-822e814c9656 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:04 devstack quobyte-client[82814]: System call of process 91500 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:33:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0ff2f5d4-6823-4985-ad3e-fa4afa6390b2 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-21d88cfa-998a-40d5-9ae0-822e814c9656" returned: 0 in 0.916s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0ff2f5d4-6823-4985-ad3e-fa4afa6390b2 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-21d88cfa-998a-40d5-9ae0-822e814c9656 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0ff2f5d4-6823-4985-ad3e-fa4afa6390b2 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-21d88cfa-998a-40d5-9ae0-822e814c9656" returned: 0 in 0.161s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:04 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0ff2f5d4-6823-4985-ad3e-fa4afa6390b2 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Lock "cinder-quobyte-21d88cfa-998a-40d5-9ae0-822e814c9656" released by "delete_volume" :: held 1.329s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:33:04 devstack cinder-volume[82800]: WARNING cinder.quota [None req-0ff2f5d4-6823-4985-ad3e-fa4afa6390b2 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:33:04 devstack cinder-volume[82800]: WARNING cinder.quota [None req-0ff2f5d4-6823-4985-ad3e-fa4afa6390b2 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:33:04 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-0ff2f5d4-6823-4985-ad3e-fa4afa6390b2 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Created reservations ['c4c74cae-f50a-4f37-9901-d19ebbc927e6', 'aedfb023-8dea-4607-b145-dd0e35ae93a2', 'b4b58df9-2d9f-444b-a35c-add16201f1cb', '11a0c4b3-7531-4f72-97b5-5c601f58c17d'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:33:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0ff2f5d4-6823-4985-ad3e-fa4afa6390b2 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:33:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0ff2f5d4-6823-4985-ad3e-fa4afa6390b2 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:33:05 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0ff2f5d4-6823-4985-ad3e-fa4afa6390b2 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:33:05 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0ff2f5d4-6823-4985-ad3e-fa4afa6390b2 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:33:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0ff2f5d4-6823-4985-ad3e-fa4afa6390b2 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:33:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0ff2f5d4-6823-4985-ad3e-fa4afa6390b2 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0ff2f5d4-6823-4985-ad3e-fa4afa6390b2 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.163s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:05 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-0ff2f5d4-6823-4985-ad3e-fa4afa6390b2 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:33:05 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-0ff2f5d4-6823-4985-ad3e-fa4afa6390b2 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Deleted volume successfully. Sep 10 15:33:05 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0ff2f5d4-6823-4985-ad3e-fa4afa6390b2 tempest-VolumeRetypeWithoutMigrationTest-223637971 None] Lock "cinder-21d88cfa-998a-40d5-9ae0-822e814c9656-delete_volume" released by "delete_volume" :: held 3.021s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:33:10 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:33:10 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:33:10 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Flow 'volume_create_manager' (3a31d6d4-eded-4ad3-8aa1-0bed035442b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:33:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac8e5ef6-3f99-40f1-b9f9-f8abb80917f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:33:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac8e5ef6-3f99-40f1-b9f9-f8abb80917f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-445294295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1bd77a4-2cdc-42d2-918a-559f9af3aa5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ffd31486d041898a2fe8f9fba4d0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:33:10Z,use_quota=True,user_id='95289c6693a44a17b667614f2946c5b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:33:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8694957-a214-454a-a4b5-37f1338fc9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:33:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8694957-a214-454a-a4b5-37f1338fc9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:33:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5f08a1-bf4e-4966-8c36-286b1923545d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:33:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5f08a1-bf4e-4966-8c36-286b1923545d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1bd77a4-2cdc-42d2-918a-559f9af3aa5b', 'volume_name': 'volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:33:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d237be-1c5b-4a7a-aec9-7631060f29cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:33:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d237be-1c5b-4a7a-aec9-7631060f29cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:33:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8130a83-0559-402d-8d09-291af85d3e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:33:11 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Volume e1bd77a4-2cdc-42d2-918a-559f9af3aa5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b', 'volume_size': 1} Sep 10 15:33:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:33:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:33:11 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-445294295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1bd77a4-2cdc-42d2-918a-559f9af3aa5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ffd31486d041898a2fe8f9fba4d0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:33:10Z,use_quota=True,user_id='95289c6693a44a17b667614f2946c5b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:33:11 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Creating volume e1bd77a4-2cdc-42d2-918a-559f9af3aa5b {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:33:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:33:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:33:11 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:33:11 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:33:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:33:11 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:33:11 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:33:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:11 devstack quobyte-client[82814]: System call of process 91576 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:33:11 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=45, name=volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:33:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b 1073741824" returned: 0 in 0.673s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b" returned: 0 in 0.195s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:12 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] <== create_volume: return (1036ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:33:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:33:12 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8130a83-0559-402d-8d09-291af85d3e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:33:12 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c2412b-93d6-4621-a003-e6c3a1b67330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:33:13 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Volume volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b (e1bd77a4-2cdc-42d2-918a-559f9af3aa5b): created successfully Sep 10 15:33:13 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c2412b-93d6-4621-a003-e6c3a1b67330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:33:13 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Flow 'volume_create_manager' (3a31d6d4-eded-4ad3-8aa1-0bed035442b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:33:13 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-e23055e6-92eb-4a3e-a868-e084fef61d42 tempest-SnapshotsActionsTest-399065424 None] Created volume successfully. Sep 10 15:33:15 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-a1617a89-b97c-4753-9bb2-14d065887e18 tempest-SnapshotsActionsTest-399065424 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:33:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a1617a89-b97c-4753-9bb2-14d065887e18 tempest-SnapshotsActionsTest-399065424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:33:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a1617a89-b97c-4753-9bb2-14d065887e18 tempest-SnapshotsActionsTest-399065424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:33:15 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-a1617a89-b97c-4753-9bb2-14d065887e18 tempest-SnapshotsActionsTest-399065424 None] Creating offline snapshot cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b of volume e1bd77a4-2cdc-42d2-918a-559f9af3aa5b {{(pid=82800) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 15:33:15 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b154517-a65d-41f8-84ff-675ba171f69b]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:33:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1617a89-b97c-4753-9bb2-14d065887e18 tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:16 devstack quobyte-client[82814]: System call of process 91589 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:33:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1617a89-b97c-4753-9bb2-14d065887e18 tempest-SnapshotsActionsTest-399065424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b" returned: 0 in 1.021s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1617a89-b97c-4753-9bb2-14d065887e18 tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:16 devstack quobyte-client[82814]: System call of process 91601 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:33:16 devstack quobyte-client[82814]: System call of process 91601 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:33:16 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=46, name=volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:33:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1617a89-b97c-4753-9bb2-14d065887e18 tempest-SnapshotsActionsTest-399065424 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b 1G" returned: 0 in 1.261s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1617a89-b97c-4753-9bb2-14d065887e18 tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1617a89-b97c-4753-9bb2-14d065887e18 tempest-SnapshotsActionsTest-399065424 None] CMD "qemu-img rebase -u -b volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b" returned: 0 in 0.732s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:18 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-a1617a89-b97c-4753-9bb2-14d065887e18 tempest-SnapshotsActionsTest-399065424 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:33:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1617a89-b97c-4753-9bb2-14d065887e18 tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1617a89-b97c-4753-9bb2-14d065887e18 tempest-SnapshotsActionsTest-399065424 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b" returned: 0 in 0.306s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:19 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-a1617a89-b97c-4753-9bb2-14d065887e18 tempest-SnapshotsActionsTest-399065424 None] Setting permissions: /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b -> 1000:1000 {{(pid=82800) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 15:33:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1617a89-b97c-4753-9bb2-14d065887e18 tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1617a89-b97c-4753-9bb2-14d065887e18 tempest-SnapshotsActionsTest-399065424 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b" returned: 0 in 0.450s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1617a89-b97c-4753-9bb2-14d065887e18 tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1617a89-b97c-4753-9bb2-14d065887e18 tempest-SnapshotsActionsTest-399065424 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.info" returned: 0 in 0.294s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:19 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-a1617a89-b97c-4753-9bb2-14d065887e18 tempest-SnapshotsActionsTest-399065424 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.info is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:33:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1617a89-b97c-4753-9bb2-14d065887e18 tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1617a89-b97c-4753-9bb2-14d065887e18 tempest-SnapshotsActionsTest-399065424 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.info" returned: 0 in 0.213s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a1617a89-b97c-4753-9bb2-14d065887e18 tempest-SnapshotsActionsTest-399065424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.332s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:33:20 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=73,cinder:UPDATE=87,cinder:DELETE=5,cinder:INSERT=16 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:33:20 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=64,cinder:UPDATE=74,cinder:INSERT=11,cinder:DELETE=5 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:33:21 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-a1617a89-b97c-4753-9bb2-14d065887e18 tempest-SnapshotsActionsTest-399065424 None] Create snapshot completed successfully Sep 10 15:33:23 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-d3e9f8bd-762a-4dd8-9641-14e34df79800 tempest-SnapshotsActionsTest-399065424 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:33:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d3e9f8bd-762a-4dd8-9641-14e34df79800 tempest-SnapshotsActionsTest-399065424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:33:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d3e9f8bd-762a-4dd8-9641-14e34df79800 tempest-SnapshotsActionsTest-399065424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.014s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:33:23 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-d3e9f8bd-762a-4dd8-9641-14e34df79800 tempest-SnapshotsActionsTest-399065424 None] Creating offline snapshot b99d275b-affb-41e8-85fd-3eb6275b7db5 of volume e1bd77a4-2cdc-42d2-918a-559f9af3aa5b {{(pid=82800) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 15:33:24 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3443f4a-3015-4f71-ac50-5074b198b574]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:33:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d3e9f8bd-762a-4dd8-9641-14e34df79800 tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:25 devstack quobyte-client[82814]: System call of process 91636 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:33:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d3e9f8bd-762a-4dd8-9641-14e34df79800 tempest-SnapshotsActionsTest-399065424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b" returned: 0 in 0.853s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-d3e9f8bd-762a-4dd8-9641-14e34df79800 tempest-SnapshotsActionsTest-399065424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:33:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d3e9f8bd-762a-4dd8-9641-14e34df79800 tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.b99d275b-affb-41e8-85fd-3eb6275b7db5 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:25 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=48, name=volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.b99d275b-affb-41e8-85fd-3eb6275b7db5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:33:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d3e9f8bd-762a-4dd8-9641-14e34df79800 tempest-SnapshotsActionsTest-399065424 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.b99d275b-affb-41e8-85fd-3eb6275b7db5 1G" returned: 0 in 0.739s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d3e9f8bd-762a-4dd8-9641-14e34df79800 tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.b99d275b-affb-41e8-85fd-3eb6275b7db5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d3e9f8bd-762a-4dd8-9641-14e34df79800 tempest-SnapshotsActionsTest-399065424 None] CMD "qemu-img rebase -u -b volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.b99d275b-affb-41e8-85fd-3eb6275b7db5" returned: 0 in 0.346s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-d3e9f8bd-762a-4dd8-9641-14e34df79800 tempest-SnapshotsActionsTest-399065424 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.b99d275b-affb-41e8-85fd-3eb6275b7db5 is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:33:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d3e9f8bd-762a-4dd8-9641-14e34df79800 tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.b99d275b-affb-41e8-85fd-3eb6275b7db5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d3e9f8bd-762a-4dd8-9641-14e34df79800 tempest-SnapshotsActionsTest-399065424 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.b99d275b-affb-41e8-85fd-3eb6275b7db5" returned: 0 in 0.193s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-d3e9f8bd-762a-4dd8-9641-14e34df79800 tempest-SnapshotsActionsTest-399065424 None] Setting permissions: /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b -> 1000:1000 {{(pid=82800) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 15:33:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d3e9f8bd-762a-4dd8-9641-14e34df79800 tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.b99d275b-affb-41e8-85fd-3eb6275b7db5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d3e9f8bd-762a-4dd8-9641-14e34df79800 tempest-SnapshotsActionsTest-399065424 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.b99d275b-affb-41e8-85fd-3eb6275b7db5" returned: 0 in 0.224s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d3e9f8bd-762a-4dd8-9641-14e34df79800 tempest-SnapshotsActionsTest-399065424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.106s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:33:27 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-d3e9f8bd-762a-4dd8-9641-14e34df79800 tempest-SnapshotsActionsTest-399065424 None] Create snapshot completed successfully Sep 10 15:33:28 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b2b6f4c7-b1e6-44d2-a128-1c8c1fefd296 tempest-SnapshotsActionsTest-194031046 None] Acquiring lock "cinder-b99d275b-affb-41e8-85fd-3eb6275b7db5-delete_snapshot" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:33:28 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b2b6f4c7-b1e6-44d2-a128-1c8c1fefd296 tempest-SnapshotsActionsTest-194031046 None] Lock "cinder-b99d275b-affb-41e8-85fd-3eb6275b7db5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.162s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:33:28 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-b2b6f4c7-b1e6-44d2-a128-1c8c1fefd296 tempest-SnapshotsActionsTest-194031046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:33:28 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b2b6f4c7-b1e6-44d2-a128-1c8c1fefd296 tempest-SnapshotsActionsTest-194031046 None] Acquiring lock "cinder-quobyte-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:33:28 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b2b6f4c7-b1e6-44d2-a128-1c8c1fefd296 tempest-SnapshotsActionsTest-194031046 None] Lock "cinder-quobyte-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:33:28 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b2b6f4c7-b1e6-44d2-a128-1c8c1fefd296 tempest-SnapshotsActionsTest-194031046 None] Acquiring lock "cinder-quobyte-b99d275b-affb-41e8-85fd-3eb6275b7db5" by "_delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:33:28 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b2b6f4c7-b1e6-44d2-a128-1c8c1fefd296 tempest-SnapshotsActionsTest-194031046 None] Lock "cinder-quobyte-b99d275b-affb-41e8-85fd-3eb6275b7db5" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:33:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-b2b6f4c7-b1e6-44d2-a128-1c8c1fefd296 tempest-SnapshotsActionsTest-194031046 None] Deleting offline snapshot b99d275b-affb-41e8-85fd-3eb6275b7db5 of volume e1bd77a4-2cdc-42d2-918a-559f9af3aa5b {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 15:33:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-b2b6f4c7-b1e6-44d2-a128-1c8c1fefd296 tempest-SnapshotsActionsTest-194031046 None] snapshot_file for this snap is: volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.b99d275b-affb-41e8-85fd-3eb6275b7db5 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 15:33:28 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b2623d-7857-418f-801a-fdc216629942]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:33:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b2b6f4c7-b1e6-44d2-a128-1c8c1fefd296 tempest-SnapshotsActionsTest-194031046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.b99d275b-affb-41e8-85fd-3eb6275b7db5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:33:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:33:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:33:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:33:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:33:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:33:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.297s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:33:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b2b6f4c7-b1e6-44d2-a128-1c8c1fefd296 tempest-SnapshotsActionsTest-194031046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.b99d275b-affb-41e8-85fd-3eb6275b7db5" returned: 0 in 1.054s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-b2b6f4c7-b1e6-44d2-a128-1c8c1fefd296 tempest-SnapshotsActionsTest-194031046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:33:30 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[79633c41-6569-4ec5-8755-9fc18d6badb2]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:33:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b2b6f4c7-b1e6-44d2-a128-1c8c1fefd296 tempest-SnapshotsActionsTest-194031046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:30 devstack quobyte-client[82814]: System call of process 91653 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:33:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b2b6f4c7-b1e6-44d2-a128-1c8c1fefd296 tempest-SnapshotsActionsTest-194031046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b" returned: 0 in 0.685s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-b2b6f4c7-b1e6-44d2-a128-1c8c1fefd296 tempest-SnapshotsActionsTest-194031046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:33:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b2b6f4c7-b1e6-44d2-a128-1c8c1fefd296 tempest-SnapshotsActionsTest-194031046 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.b99d275b-affb-41e8-85fd-3eb6275b7db5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:30 devstack quobyte-client[82814]: System call of process 91657 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:33:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b2b6f4c7-b1e6-44d2-a128-1c8c1fefd296 tempest-SnapshotsActionsTest-194031046 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.b99d275b-affb-41e8-85fd-3eb6275b7db5" returned: 0 in 0.409s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b2b6f4c7-b1e6-44d2-a128-1c8c1fefd296 tempest-SnapshotsActionsTest-194031046 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.b99d275b-affb-41e8-85fd-3eb6275b7db5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b2b6f4c7-b1e6-44d2-a128-1c8c1fefd296 tempest-SnapshotsActionsTest-194031046 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.b99d275b-affb-41e8-85fd-3eb6275b7db5" returned: 0 in 0.230s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:31 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b2b6f4c7-b1e6-44d2-a128-1c8c1fefd296 tempest-SnapshotsActionsTest-194031046 None] Lock "cinder-quobyte-b99d275b-affb-41e8-85fd-3eb6275b7db5" released by "_delete_snapshot" :: held 2.777s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:33:31 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b2b6f4c7-b1e6-44d2-a128-1c8c1fefd296 tempest-SnapshotsActionsTest-194031046 None] Lock "cinder-quobyte-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b" released by "delete_snapshot" :: held 2.847s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:33:32 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-b2b6f4c7-b1e6-44d2-a128-1c8c1fefd296 tempest-SnapshotsActionsTest-194031046 None] Created reservations ['850417eb-3bfc-4273-b6e0-44c5f3dea68b', '0a2042ac-81c0-4800-8bcd-10a45da7652f', 'b2b959d0-baa1-48c0-945e-b1fc97852b8a', '518d6544-0e83-4b5b-a6b9-854b32f24253'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:33:32 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-b2b6f4c7-b1e6-44d2-a128-1c8c1fefd296 tempest-SnapshotsActionsTest-194031046 None] Delete snapshot completed successfully. Sep 10 15:33:32 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b2b6f4c7-b1e6-44d2-a128-1c8c1fefd296 tempest-SnapshotsActionsTest-194031046 None] Lock "cinder-b99d275b-affb-41e8-85fd-3eb6275b7db5-delete_snapshot" released by "delete_snapshot" :: held 3.686s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:33:33 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-76cb2cfa-c451-4faf-9bff-bfd6a4ee297e tempest-SnapshotsActionsTest-399065424 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:33:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-76cb2cfa-c451-4faf-9bff-bfd6a4ee297e tempest-SnapshotsActionsTest-399065424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:33:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-76cb2cfa-c451-4faf-9bff-bfd6a4ee297e tempest-SnapshotsActionsTest-399065424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:33:34 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-76cb2cfa-c451-4faf-9bff-bfd6a4ee297e tempest-SnapshotsActionsTest-399065424 None] Creating offline snapshot 041a0826-77e6-48c6-9c3c-dc01ecb183a1 of volume e1bd77a4-2cdc-42d2-918a-559f9af3aa5b {{(pid=82800) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 15:33:34 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6dc13ee-6aa4-47f0-828d-23f5af466cf1]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:33:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-76cb2cfa-c451-4faf-9bff-bfd6a4ee297e tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-76cb2cfa-c451-4faf-9bff-bfd6a4ee297e tempest-SnapshotsActionsTest-399065424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b" returned: 0 in 0.594s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:34 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-76cb2cfa-c451-4faf-9bff-bfd6a4ee297e tempest-SnapshotsActionsTest-399065424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:33:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-76cb2cfa-c451-4faf-9bff-bfd6a4ee297e tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.041a0826-77e6-48c6-9c3c-dc01ecb183a1 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:35 devstack quobyte-client[82814]: System call of process 91664 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:33:35 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=49, name=volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.041a0826-77e6-48c6-9c3c-dc01ecb183a1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:33:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-76cb2cfa-c451-4faf-9bff-bfd6a4ee297e tempest-SnapshotsActionsTest-399065424 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.041a0826-77e6-48c6-9c3c-dc01ecb183a1 1G" returned: 0 in 0.442s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-76cb2cfa-c451-4faf-9bff-bfd6a4ee297e tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.041a0826-77e6-48c6-9c3c-dc01ecb183a1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:35 devstack quobyte-client[82814]: System call of process 91667 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:33:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-76cb2cfa-c451-4faf-9bff-bfd6a4ee297e tempest-SnapshotsActionsTest-399065424 None] CMD "qemu-img rebase -u -b volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.041a0826-77e6-48c6-9c3c-dc01ecb183a1" returned: 0 in 0.249s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:35 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-76cb2cfa-c451-4faf-9bff-bfd6a4ee297e tempest-SnapshotsActionsTest-399065424 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.041a0826-77e6-48c6-9c3c-dc01ecb183a1 is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:33:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-76cb2cfa-c451-4faf-9bff-bfd6a4ee297e tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.041a0826-77e6-48c6-9c3c-dc01ecb183a1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-76cb2cfa-c451-4faf-9bff-bfd6a4ee297e tempest-SnapshotsActionsTest-399065424 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.041a0826-77e6-48c6-9c3c-dc01ecb183a1" returned: 0 in 0.158s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:35 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-76cb2cfa-c451-4faf-9bff-bfd6a4ee297e tempest-SnapshotsActionsTest-399065424 None] Setting permissions: /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b -> 1000:1000 {{(pid=82800) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 15:33:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-76cb2cfa-c451-4faf-9bff-bfd6a4ee297e tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.041a0826-77e6-48c6-9c3c-dc01ecb183a1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-76cb2cfa-c451-4faf-9bff-bfd6a4ee297e tempest-SnapshotsActionsTest-399065424 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.041a0826-77e6-48c6-9c3c-dc01ecb183a1" returned: 0 in 0.179s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-76cb2cfa-c451-4faf-9bff-bfd6a4ee297e tempest-SnapshotsActionsTest-399065424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.135s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:33:36 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-76cb2cfa-c451-4faf-9bff-bfd6a4ee297e tempest-SnapshotsActionsTest-399065424 None] Create snapshot completed successfully Sep 10 15:33:37 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0c13d568-b537-4d69-91c7-a67c4ea93cbb tempest-SnapshotsActionsTest-194031046 None] Acquiring lock "cinder-041a0826-77e6-48c6-9c3c-dc01ecb183a1-delete_snapshot" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:33:37 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0c13d568-b537-4d69-91c7-a67c4ea93cbb tempest-SnapshotsActionsTest-194031046 None] Lock "cinder-041a0826-77e6-48c6-9c3c-dc01ecb183a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:33:37 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-0c13d568-b537-4d69-91c7-a67c4ea93cbb tempest-SnapshotsActionsTest-194031046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:33:37 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0c13d568-b537-4d69-91c7-a67c4ea93cbb tempest-SnapshotsActionsTest-194031046 None] Acquiring lock "cinder-quobyte-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:33:37 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0c13d568-b537-4d69-91c7-a67c4ea93cbb tempest-SnapshotsActionsTest-194031046 None] Lock "cinder-quobyte-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:33:37 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0c13d568-b537-4d69-91c7-a67c4ea93cbb tempest-SnapshotsActionsTest-194031046 None] Acquiring lock "cinder-quobyte-041a0826-77e6-48c6-9c3c-dc01ecb183a1" by "_delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:33:37 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0c13d568-b537-4d69-91c7-a67c4ea93cbb tempest-SnapshotsActionsTest-194031046 None] Lock "cinder-quobyte-041a0826-77e6-48c6-9c3c-dc01ecb183a1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:33:37 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-0c13d568-b537-4d69-91c7-a67c4ea93cbb tempest-SnapshotsActionsTest-194031046 None] Deleting offline snapshot 041a0826-77e6-48c6-9c3c-dc01ecb183a1 of volume e1bd77a4-2cdc-42d2-918a-559f9af3aa5b {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 15:33:37 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-0c13d568-b537-4d69-91c7-a67c4ea93cbb tempest-SnapshotsActionsTest-194031046 None] snapshot_file for this snap is: volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.041a0826-77e6-48c6-9c3c-dc01ecb183a1 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 15:33:37 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cf1007-7f5f-40bf-aed8-1d107e81e62a]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:33:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0c13d568-b537-4d69-91c7-a67c4ea93cbb tempest-SnapshotsActionsTest-194031046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.041a0826-77e6-48c6-9c3c-dc01ecb183a1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:38 devstack quobyte-client[82814]: System call of process 91672 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:33:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0c13d568-b537-4d69-91c7-a67c4ea93cbb tempest-SnapshotsActionsTest-194031046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.041a0826-77e6-48c6-9c3c-dc01ecb183a1" returned: 0 in 0.642s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:38 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-0c13d568-b537-4d69-91c7-a67c4ea93cbb tempest-SnapshotsActionsTest-194031046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:33:38 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd76b10b-eee7-497c-8f15-89729ccb864b]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:33:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0c13d568-b537-4d69-91c7-a67c4ea93cbb tempest-SnapshotsActionsTest-194031046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:39 devstack quobyte-client[82814]: System call of process 91675 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:33:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0c13d568-b537-4d69-91c7-a67c4ea93cbb tempest-SnapshotsActionsTest-194031046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b" returned: 0 in 0.762s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:39 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-0c13d568-b537-4d69-91c7-a67c4ea93cbb tempest-SnapshotsActionsTest-194031046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:33:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0c13d568-b537-4d69-91c7-a67c4ea93cbb tempest-SnapshotsActionsTest-194031046 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.041a0826-77e6-48c6-9c3c-dc01ecb183a1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0c13d568-b537-4d69-91c7-a67c4ea93cbb tempest-SnapshotsActionsTest-194031046 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.041a0826-77e6-48c6-9c3c-dc01ecb183a1" returned: 0 in 0.334s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0c13d568-b537-4d69-91c7-a67c4ea93cbb tempest-SnapshotsActionsTest-194031046 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.041a0826-77e6-48c6-9c3c-dc01ecb183a1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0c13d568-b537-4d69-91c7-a67c4ea93cbb tempest-SnapshotsActionsTest-194031046 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.041a0826-77e6-48c6-9c3c-dc01ecb183a1" returned: 0 in 0.135s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:39 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0c13d568-b537-4d69-91c7-a67c4ea93cbb tempest-SnapshotsActionsTest-194031046 None] Lock "cinder-quobyte-041a0826-77e6-48c6-9c3c-dc01ecb183a1" released by "_delete_snapshot" :: held 2.275s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:33:39 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0c13d568-b537-4d69-91c7-a67c4ea93cbb tempest-SnapshotsActionsTest-194031046 None] Lock "cinder-quobyte-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b" released by "delete_snapshot" :: held 2.304s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:33:40 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-0c13d568-b537-4d69-91c7-a67c4ea93cbb tempest-SnapshotsActionsTest-194031046 None] Created reservations ['7673b7e5-060a-4bb3-8e00-ef0f007d9a01', 'ec1a82f0-33a5-4b19-b903-b8ab69fe941d', 'b5b3fd1f-ad9f-4842-9de8-618a28074afc', 'e4b03385-92cb-41a4-a96a-ce135d383f3c'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:33:40 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-0c13d568-b537-4d69-91c7-a67c4ea93cbb tempest-SnapshotsActionsTest-194031046 None] Delete snapshot completed successfully. Sep 10 15:33:40 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0c13d568-b537-4d69-91c7-a67c4ea93cbb tempest-SnapshotsActionsTest-194031046 None] Lock "cinder-041a0826-77e6-48c6-9c3c-dc01ecb183a1-delete_snapshot" released by "delete_snapshot" :: held 2.892s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:33:41 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-52346345-165d-43d3-a4fb-5f8dbb4af3bb tempest-SnapshotsActionsTest-399065424 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:33:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-52346345-165d-43d3-a4fb-5f8dbb4af3bb tempest-SnapshotsActionsTest-399065424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:33:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-52346345-165d-43d3-a4fb-5f8dbb4af3bb tempest-SnapshotsActionsTest-399065424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:33:41 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-52346345-165d-43d3-a4fb-5f8dbb4af3bb tempest-SnapshotsActionsTest-399065424 None] Creating offline snapshot 8a727b4b-4510-4982-9f46-8013572752fa of volume e1bd77a4-2cdc-42d2-918a-559f9af3aa5b {{(pid=82800) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 15:33:41 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac90655a-1358-4ff0-81dd-14ed9df04ccc]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:33:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-52346345-165d-43d3-a4fb-5f8dbb4af3bb tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-52346345-165d-43d3-a4fb-5f8dbb4af3bb tempest-SnapshotsActionsTest-399065424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b" returned: 0 in 0.560s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:42 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-52346345-165d-43d3-a4fb-5f8dbb4af3bb tempest-SnapshotsActionsTest-399065424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:33:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-52346345-165d-43d3-a4fb-5f8dbb4af3bb tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.8a727b4b-4510-4982-9f46-8013572752fa 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:42 devstack quobyte-client[82814]: System call of process 91686 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:33:42 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=50, name=volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.8a727b4b-4510-4982-9f46-8013572752fa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:33:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-52346345-165d-43d3-a4fb-5f8dbb4af3bb tempest-SnapshotsActionsTest-399065424 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.8a727b4b-4510-4982-9f46-8013572752fa 1G" returned: 0 in 0.441s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-52346345-165d-43d3-a4fb-5f8dbb4af3bb tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.8a727b4b-4510-4982-9f46-8013572752fa {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-52346345-165d-43d3-a4fb-5f8dbb4af3bb tempest-SnapshotsActionsTest-399065424 None] CMD "qemu-img rebase -u -b volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.8a727b4b-4510-4982-9f46-8013572752fa" returned: 0 in 0.213s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:43 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-52346345-165d-43d3-a4fb-5f8dbb4af3bb tempest-SnapshotsActionsTest-399065424 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.8a727b4b-4510-4982-9f46-8013572752fa is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:33:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-52346345-165d-43d3-a4fb-5f8dbb4af3bb tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.8a727b4b-4510-4982-9f46-8013572752fa {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-52346345-165d-43d3-a4fb-5f8dbb4af3bb tempest-SnapshotsActionsTest-399065424 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.8a727b4b-4510-4982-9f46-8013572752fa" returned: 0 in 0.135s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:43 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-52346345-165d-43d3-a4fb-5f8dbb4af3bb tempest-SnapshotsActionsTest-399065424 None] Setting permissions: /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b -> 1000:1000 {{(pid=82800) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 15:33:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-52346345-165d-43d3-a4fb-5f8dbb4af3bb tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.8a727b4b-4510-4982-9f46-8013572752fa {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-52346345-165d-43d3-a4fb-5f8dbb4af3bb tempest-SnapshotsActionsTest-399065424 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.8a727b4b-4510-4982-9f46-8013572752fa" returned: 0 in 0.139s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-52346345-165d-43d3-a4fb-5f8dbb4af3bb tempest-SnapshotsActionsTest-399065424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.005s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:33:44 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-52346345-165d-43d3-a4fb-5f8dbb4af3bb tempest-SnapshotsActionsTest-399065424 None] Create snapshot completed successfully Sep 10 15:33:44 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4df1aab6-5b0c-41ad-8f94-ed1ac6900a40 tempest-SnapshotsActionsTest-194031046 None] Acquiring lock "cinder-8a727b4b-4510-4982-9f46-8013572752fa-delete_snapshot" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:33:45 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4df1aab6-5b0c-41ad-8f94-ed1ac6900a40 tempest-SnapshotsActionsTest-194031046 None] Lock "cinder-8a727b4b-4510-4982-9f46-8013572752fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.100s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:33:45 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-4df1aab6-5b0c-41ad-8f94-ed1ac6900a40 tempest-SnapshotsActionsTest-194031046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:33:45 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4df1aab6-5b0c-41ad-8f94-ed1ac6900a40 tempest-SnapshotsActionsTest-194031046 None] Acquiring lock "cinder-quobyte-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:33:45 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4df1aab6-5b0c-41ad-8f94-ed1ac6900a40 tempest-SnapshotsActionsTest-194031046 None] Lock "cinder-quobyte-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:33:45 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4df1aab6-5b0c-41ad-8f94-ed1ac6900a40 tempest-SnapshotsActionsTest-194031046 None] Acquiring lock "cinder-quobyte-8a727b4b-4510-4982-9f46-8013572752fa" by "_delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:33:45 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4df1aab6-5b0c-41ad-8f94-ed1ac6900a40 tempest-SnapshotsActionsTest-194031046 None] Lock "cinder-quobyte-8a727b4b-4510-4982-9f46-8013572752fa" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:33:45 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-4df1aab6-5b0c-41ad-8f94-ed1ac6900a40 tempest-SnapshotsActionsTest-194031046 None] Deleting offline snapshot 8a727b4b-4510-4982-9f46-8013572752fa of volume e1bd77a4-2cdc-42d2-918a-559f9af3aa5b {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 15:33:45 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-4df1aab6-5b0c-41ad-8f94-ed1ac6900a40 tempest-SnapshotsActionsTest-194031046 None] snapshot_file for this snap is: volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.8a727b4b-4510-4982-9f46-8013572752fa {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 15:33:45 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a62e77a-a40a-4126-b1ac-6f60d4480f14]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:33:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4df1aab6-5b0c-41ad-8f94-ed1ac6900a40 tempest-SnapshotsActionsTest-194031046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.8a727b4b-4510-4982-9f46-8013572752fa {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4df1aab6-5b0c-41ad-8f94-ed1ac6900a40 tempest-SnapshotsActionsTest-194031046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.8a727b4b-4510-4982-9f46-8013572752fa" returned: 0 in 0.716s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:45 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-4df1aab6-5b0c-41ad-8f94-ed1ac6900a40 tempest-SnapshotsActionsTest-194031046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:33:45 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab463a8-18b2-42bb-b2a2-231a069edae9]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:33:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4df1aab6-5b0c-41ad-8f94-ed1ac6900a40 tempest-SnapshotsActionsTest-194031046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4df1aab6-5b0c-41ad-8f94-ed1ac6900a40 tempest-SnapshotsActionsTest-194031046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b" returned: 0 in 0.731s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-4df1aab6-5b0c-41ad-8f94-ed1ac6900a40 tempest-SnapshotsActionsTest-194031046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:33:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4df1aab6-5b0c-41ad-8f94-ed1ac6900a40 tempest-SnapshotsActionsTest-194031046 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.8a727b4b-4510-4982-9f46-8013572752fa {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:46 devstack quobyte-client[82814]: System call of process 91710 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:33:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4df1aab6-5b0c-41ad-8f94-ed1ac6900a40 tempest-SnapshotsActionsTest-194031046 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.8a727b4b-4510-4982-9f46-8013572752fa" returned: 0 in 0.266s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4df1aab6-5b0c-41ad-8f94-ed1ac6900a40 tempest-SnapshotsActionsTest-194031046 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.8a727b4b-4510-4982-9f46-8013572752fa {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4df1aab6-5b0c-41ad-8f94-ed1ac6900a40 tempest-SnapshotsActionsTest-194031046 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.8a727b4b-4510-4982-9f46-8013572752fa" returned: 0 in 0.170s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:47 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4df1aab6-5b0c-41ad-8f94-ed1ac6900a40 tempest-SnapshotsActionsTest-194031046 None] Lock "cinder-quobyte-8a727b4b-4510-4982-9f46-8013572752fa" released by "_delete_snapshot" :: held 2.225s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:33:47 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4df1aab6-5b0c-41ad-8f94-ed1ac6900a40 tempest-SnapshotsActionsTest-194031046 None] Lock "cinder-quobyte-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b" released by "delete_snapshot" :: held 2.264s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:33:47 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-4df1aab6-5b0c-41ad-8f94-ed1ac6900a40 tempest-SnapshotsActionsTest-194031046 None] Created reservations ['d2e0dec2-0419-41f6-931e-7a6c1adbd300', 'f4cc214a-5bca-4552-a106-118e88d64608', '43be5c96-0509-452e-8cd5-9c8399052977', '7ecb322e-c62c-4170-b74e-9d6883072879'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:33:47 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-4df1aab6-5b0c-41ad-8f94-ed1ac6900a40 tempest-SnapshotsActionsTest-194031046 None] Delete snapshot completed successfully. Sep 10 15:33:47 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4df1aab6-5b0c-41ad-8f94-ed1ac6900a40 tempest-SnapshotsActionsTest-194031046 None] Lock "cinder-8a727b4b-4510-4982-9f46-8013572752fa-delete_snapshot" released by "delete_snapshot" :: held 2.879s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:33:49 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-84f0be81-8908-4e41-9d8e-f9bd25d323f5 tempest-SnapshotsActionsTest-399065424 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:33:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-84f0be81-8908-4e41-9d8e-f9bd25d323f5 tempest-SnapshotsActionsTest-399065424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:33:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-84f0be81-8908-4e41-9d8e-f9bd25d323f5 tempest-SnapshotsActionsTest-399065424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:33:49 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-84f0be81-8908-4e41-9d8e-f9bd25d323f5 tempest-SnapshotsActionsTest-399065424 None] Creating offline snapshot 7867d20c-b7c5-42ea-8f0e-71000aee2062 of volume e1bd77a4-2cdc-42d2-918a-559f9af3aa5b {{(pid=82800) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 15:33:49 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd52b838-e4d2-4c1c-bacf-d16f3a51ae15]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:33:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-84f0be81-8908-4e41-9d8e-f9bd25d323f5 tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-84f0be81-8908-4e41-9d8e-f9bd25d323f5 tempest-SnapshotsActionsTest-399065424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b" returned: 0 in 0.564s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:49 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-84f0be81-8908-4e41-9d8e-f9bd25d323f5 tempest-SnapshotsActionsTest-399065424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:33:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-84f0be81-8908-4e41-9d8e-f9bd25d323f5 tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.7867d20c-b7c5-42ea-8f0e-71000aee2062 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:50 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=51, name=volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.7867d20c-b7c5-42ea-8f0e-71000aee2062, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:33:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-84f0be81-8908-4e41-9d8e-f9bd25d323f5 tempest-SnapshotsActionsTest-399065424 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.7867d20c-b7c5-42ea-8f0e-71000aee2062 1G" returned: 0 in 0.340s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-84f0be81-8908-4e41-9d8e-f9bd25d323f5 tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): qemu-img rebase -u -b volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.7867d20c-b7c5-42ea-8f0e-71000aee2062 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-84f0be81-8908-4e41-9d8e-f9bd25d323f5 tempest-SnapshotsActionsTest-399065424 None] CMD "qemu-img rebase -u -b volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.7867d20c-b7c5-42ea-8f0e-71000aee2062" returned: 0 in 0.224s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:50 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-84f0be81-8908-4e41-9d8e-f9bd25d323f5 tempest-SnapshotsActionsTest-399065424 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.7867d20c-b7c5-42ea-8f0e-71000aee2062 is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:33:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-84f0be81-8908-4e41-9d8e-f9bd25d323f5 tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.7867d20c-b7c5-42ea-8f0e-71000aee2062 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-84f0be81-8908-4e41-9d8e-f9bd25d323f5 tempest-SnapshotsActionsTest-399065424 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.7867d20c-b7c5-42ea-8f0e-71000aee2062" returned: 0 in 0.131s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:50 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-84f0be81-8908-4e41-9d8e-f9bd25d323f5 tempest-SnapshotsActionsTest-399065424 None] Setting permissions: /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b -> 1000:1000 {{(pid=82800) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 15:33:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-84f0be81-8908-4e41-9d8e-f9bd25d323f5 tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.7867d20c-b7c5-42ea-8f0e-71000aee2062 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-84f0be81-8908-4e41-9d8e-f9bd25d323f5 tempest-SnapshotsActionsTest-399065424 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.7867d20c-b7c5-42ea-8f0e-71000aee2062" returned: 0 in 0.141s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-84f0be81-8908-4e41-9d8e-f9bd25d323f5 tempest-SnapshotsActionsTest-399065424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.749s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:33:51 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-84f0be81-8908-4e41-9d8e-f9bd25d323f5 tempest-SnapshotsActionsTest-399065424 None] Create snapshot completed successfully Sep 10 15:33:51 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:33:51 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:33:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Flow 'volume_create_manager' (fb68ef00-c3aa-447c-beac-9ece2da165d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:33:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (069202ff-3051-4d65-92e7-f5a49bddac64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:33:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (069202ff-3051-4d65-92e7-f5a49bddac64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2017156237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a17420-e1ca-4ba7-b09b-4b20149a33de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='084ea203476a4782a75056e007c7b628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:33:52Z,use_quota=True,user_id='022953e4e34b4c92aad66dea54350361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:33:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7063c714-7213-412e-8680-68f0046984cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:33:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7063c714-7213-412e-8680-68f0046984cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:33:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e85ac38-22c0-460f-a96c-3765240b946a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:33:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e85ac38-22c0-460f-a96c-3765240b946a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '31a17420-e1ca-4ba7-b09b-4b20149a33de', 'volume_name': 'volume-31a17420-e1ca-4ba7-b09b-4b20149a33de', 'volume_size': 1, 'image_id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd75fe9cbcc7343938450d0505f3f0f02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'created_at': datetime.datetime(2025, 9, 10, 13, 6, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 13, 6, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa69f997-7136-4bd6-b8ef-95a111ba2ea1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:33:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03cc8343-604c-4e5f-8df1-215551768711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:33:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03cc8343-604c-4e5f-8df1-215551768711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:33:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2766210b-868c-4e50-98c1-942919003f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:33:52 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Volume 31a17420-e1ca-4ba7-b09b-4b20149a33de: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-31a17420-e1ca-4ba7-b09b-4b20149a33de', 'volume_size': 1, 'image_id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd75fe9cbcc7343938450d0505f3f0f02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'created_at': datetime.datetime(2025, 9, 10, 13, 6, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 13, 6, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa69f997-7136-4bd6-b8ef-95a111ba2ea1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 15:33:52 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Cloning 31a17420-e1ca-4ba7-b09b-4b20149a33de from image aa69f997-7136-4bd6-b8ef-95a111ba2ea1 at location (None, None). {{(pid=82800) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 15:33:52 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-7231b6a7-e28f-45fc-94e8-5f5c50bf4a21 tempest-SnapshotsActionsTest-194031046 None] Acquiring lock "cinder-7867d20c-b7c5-42ea-8f0e-71000aee2062-delete_snapshot" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:33:52 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-7231b6a7-e28f-45fc-94e8-5f5c50bf4a21 tempest-SnapshotsActionsTest-194031046 None] Lock "cinder-7867d20c-b7c5-42ea-8f0e-71000aee2062-delete_snapshot" acquired by "delete_snapshot" :: waited 0.082s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:33:52 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-7231b6a7-e28f-45fc-94e8-5f5c50bf4a21 tempest-SnapshotsActionsTest-194031046 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:33:52 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-7231b6a7-e28f-45fc-94e8-5f5c50bf4a21 tempest-SnapshotsActionsTest-194031046 None] Acquiring lock "cinder-quobyte-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:33:52 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-7231b6a7-e28f-45fc-94e8-5f5c50bf4a21 tempest-SnapshotsActionsTest-194031046 None] Lock "cinder-quobyte-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:33:52 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-7231b6a7-e28f-45fc-94e8-5f5c50bf4a21 tempest-SnapshotsActionsTest-194031046 None] Acquiring lock "cinder-quobyte-7867d20c-b7c5-42ea-8f0e-71000aee2062" by "_delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:33:52 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-7231b6a7-e28f-45fc-94e8-5f5c50bf4a21 tempest-SnapshotsActionsTest-194031046 None] Lock "cinder-quobyte-7867d20c-b7c5-42ea-8f0e-71000aee2062" acquired by "_delete_snapshot" :: waited 0.142s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:33:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-7231b6a7-e28f-45fc-94e8-5f5c50bf4a21 tempest-SnapshotsActionsTest-194031046 None] Deleting offline snapshot 7867d20c-b7c5-42ea-8f0e-71000aee2062 of volume e1bd77a4-2cdc-42d2-918a-559f9af3aa5b {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 15:33:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-7231b6a7-e28f-45fc-94e8-5f5c50bf4a21 tempest-SnapshotsActionsTest-194031046 None] snapshot_file for this snap is: volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.7867d20c-b7c5-42ea-8f0e-71000aee2062 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 15:33:52 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2b4ac7-4404-4205-a9c5-b947aa9da5d0]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:33:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7231b6a7-e28f-45fc-94e8-5f5c50bf4a21 tempest-SnapshotsActionsTest-194031046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.7867d20c-b7c5-42ea-8f0e-71000aee2062 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:53 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_ljlbwgx8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82800) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 15:33:53 devstack cinder-volume[82800]: INFO cinder.image.image_utils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Image download 20.69 MB at 20.69 MB/s Sep 10 15:33:53 devstack quobyte-client[82814]: System call of process 91746 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:33:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7231b6a7-e28f-45fc-94e8-5f5c50bf4a21 tempest-SnapshotsActionsTest-194031046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.7867d20c-b7c5-42ea-8f0e-71000aee2062" returned: 0 in 0.558s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-7231b6a7-e28f-45fc-94e8-5f5c50bf4a21 tempest-SnapshotsActionsTest-194031046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:33:53 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83db767-01d2-45dc-bb15-c1ea5735aa18]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:33:53 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ca10ea-e572-4a7a-90cc-da2742b67710]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:33:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7231b6a7-e28f-45fc-94e8-5f5c50bf4a21 tempest-SnapshotsActionsTest-194031046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_ljlbwgx8devstack@QuobyteHD {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:54 devstack sudo[91750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_ljlbwgx8devstack@QuobyteHD Sep 10 15:33:54 devstack sudo[91750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:33:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7231b6a7-e28f-45fc-94e8-5f5c50bf4a21 tempest-SnapshotsActionsTest-194031046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b" returned: 0 in 0.722s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:54 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-7231b6a7-e28f-45fc-94e8-5f5c50bf4a21 tempest-SnapshotsActionsTest-194031046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:33:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7231b6a7-e28f-45fc-94e8-5f5c50bf4a21 tempest-SnapshotsActionsTest-194031046 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.7867d20c-b7c5-42ea-8f0e-71000aee2062 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7231b6a7-e28f-45fc-94e8-5f5c50bf4a21 tempest-SnapshotsActionsTest-194031046 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.7867d20c-b7c5-42ea-8f0e-71000aee2062" returned: 0 in 0.327s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7231b6a7-e28f-45fc-94e8-5f5c50bf4a21 tempest-SnapshotsActionsTest-194031046 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.7867d20c-b7c5-42ea-8f0e-71000aee2062 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7231b6a7-e28f-45fc-94e8-5f5c50bf4a21 tempest-SnapshotsActionsTest-194031046 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.7867d20c-b7c5-42ea-8f0e-71000aee2062" returned: 0 in 0.172s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-7231b6a7-e28f-45fc-94e8-5f5c50bf4a21 tempest-SnapshotsActionsTest-194031046 None] Lock "cinder-quobyte-7867d20c-b7c5-42ea-8f0e-71000aee2062" released by "_delete_snapshot" :: held 2.160s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:33:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-7231b6a7-e28f-45fc-94e8-5f5c50bf4a21 tempest-SnapshotsActionsTest-194031046 None] Lock "cinder-quobyte-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b" released by "delete_snapshot" :: held 2.314s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:33:55 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-7231b6a7-e28f-45fc-94e8-5f5c50bf4a21 tempest-SnapshotsActionsTest-194031046 None] Created reservations ['b2f5cf0b-8d3c-44c3-a197-c5e1df8e8067', '2135f45c-06ee-4bdb-ad34-ab889892fdbb', 'b3e5ce5f-8402-4b45-97c2-62f267d888c3', 'fd32d5d5-b93a-4026-bb11-ed592a998848'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:33:55 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-7231b6a7-e28f-45fc-94e8-5f5c50bf4a21 tempest-SnapshotsActionsTest-194031046 None] Delete snapshot completed successfully. Sep 10 15:33:55 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-7231b6a7-e28f-45fc-94e8-5f5c50bf4a21 tempest-SnapshotsActionsTest-194031046 None] Lock "cinder-7867d20c-b7c5-42ea-8f0e-71000aee2062-delete_snapshot" released by "delete_snapshot" :: held 2.967s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:33:56 devstack sudo[91750]: pam_unix(sudo:session): session closed for user root Sep 10 15:33:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_ljlbwgx8devstack@QuobyteHD" returned: 0 in 3.214s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:56 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Temporary image aa69f997-7136-4bd6-b8ef-95a111ba2ea1 is fetched for user 022953e4e34b4c92aad66dea54350361. {{(pid=82800) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 15:33:56 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-107280d0-ac4e-4ebc-9bc5-c362278ed023 tempest-SnapshotsActionsTest-399065424 None] Acquiring lock "cinder-cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b-delete_snapshot" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:33:56 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-107280d0-ac4e-4ebc-9bc5-c362278ed023 tempest-SnapshotsActionsTest-399065424 None] Lock "cinder-cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:33:56 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-107280d0-ac4e-4ebc-9bc5-c362278ed023 tempest-SnapshotsActionsTest-399065424 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:33:56 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-107280d0-ac4e-4ebc-9bc5-c362278ed023 tempest-SnapshotsActionsTest-399065424 None] Acquiring lock "cinder-quobyte-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:33:56 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-107280d0-ac4e-4ebc-9bc5-c362278ed023 tempest-SnapshotsActionsTest-399065424 None] Lock "cinder-quobyte-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:33:57 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-107280d0-ac4e-4ebc-9bc5-c362278ed023 tempest-SnapshotsActionsTest-399065424 None] Acquiring lock "cinder-quobyte-cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b" by "_delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:33:57 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-107280d0-ac4e-4ebc-9bc5-c362278ed023 tempest-SnapshotsActionsTest-399065424 None] Lock "cinder-quobyte-cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:33:57 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-107280d0-ac4e-4ebc-9bc5-c362278ed023 tempest-SnapshotsActionsTest-399065424 None] Deleting offline snapshot cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b of volume e1bd77a4-2cdc-42d2-918a-559f9af3aa5b {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 15:33:57 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-107280d0-ac4e-4ebc-9bc5-c362278ed023 tempest-SnapshotsActionsTest-399065424 None] snapshot_file for this snap is: volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 15:33:57 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d098c3-9e4d-4ce9-bdee-8c48de608822]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:33:57 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02ebf56-0c1f-415b-aa92-606a8f090264]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:33:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-107280d0-ac4e-4ebc-9bc5-c362278ed023 tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_ljlbwgx8devstack@QuobyteHD {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-107280d0-ac4e-4ebc-9bc5-c362278ed023 tempest-SnapshotsActionsTest-399065424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b" returned: 0 in 0.652s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:57 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-107280d0-ac4e-4ebc-9bc5-c362278ed023 tempest-SnapshotsActionsTest-399065424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:33:57 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c72e45-5864-47cc-b675-8c1b93b85da4]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:33:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-107280d0-ac4e-4ebc-9bc5-c362278ed023 tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:57 devstack sudo[91763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_ljlbwgx8devstack@QuobyteHD Sep 10 15:33:57 devstack sudo[91763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:33:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-107280d0-ac4e-4ebc-9bc5-c362278ed023 tempest-SnapshotsActionsTest-399065424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b" returned: 0 in 0.731s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-107280d0-ac4e-4ebc-9bc5-c362278ed023 tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-107280d0-ac4e-4ebc-9bc5-c362278ed023 tempest-SnapshotsActionsTest-399065424 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b" returned: 0 in 0.317s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-107280d0-ac4e-4ebc-9bc5-c362278ed023 tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:33:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-107280d0-ac4e-4ebc-9bc5-c362278ed023 tempest-SnapshotsActionsTest-399065424 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b.cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b" returned: 0 in 0.167s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:33:59 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-107280d0-ac4e-4ebc-9bc5-c362278ed023 tempest-SnapshotsActionsTest-399065424 None] Lock "cinder-quobyte-cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b" released by "_delete_snapshot" :: held 2.338s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:33:59 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-107280d0-ac4e-4ebc-9bc5-c362278ed023 tempest-SnapshotsActionsTest-399065424 None] Lock "cinder-quobyte-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b" released by "delete_snapshot" :: held 2.365s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:33:59 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-107280d0-ac4e-4ebc-9bc5-c362278ed023 tempest-SnapshotsActionsTest-399065424 None] Created reservations ['5ac0981b-2863-4395-abcf-e7e83d5c200e', '37f5a702-d8fb-445f-98a3-9fdeb58c2129', '92c55a1b-195b-48da-a1ef-4923b9069157', '1d287c67-5e5a-475e-a671-ada58ac3338a'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:34:00 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-107280d0-ac4e-4ebc-9bc5-c362278ed023 tempest-SnapshotsActionsTest-399065424 None] Delete snapshot completed successfully. Sep 10 15:34:00 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-107280d0-ac4e-4ebc-9bc5-c362278ed023 tempest-SnapshotsActionsTest-399065424 None] Lock "cinder-cc0aa96d-ba14-4fe3-a5c3-3fb48bc18f8b-delete_snapshot" released by "delete_snapshot" :: held 3.140s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:34:00 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-956ce829-0935-4bff-a85a-94b3926bb063 tempest-SnapshotsActionsTest-399065424 None] Acquiring lock "cinder-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:34:00 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-956ce829-0935-4bff-a85a-94b3926bb063 tempest-SnapshotsActionsTest-399065424 None] Lock "cinder-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:34:00 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-956ce829-0935-4bff-a85a-94b3926bb063 tempest-SnapshotsActionsTest-399065424 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:34:00 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-956ce829-0935-4bff-a85a-94b3926bb063 tempest-SnapshotsActionsTest-399065424 None] Acquiring lock "cinder-quobyte-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:34:00 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-956ce829-0935-4bff-a85a-94b3926bb063 tempest-SnapshotsActionsTest-399065424 None] Lock "cinder-quobyte-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b" acquired by "delete_volume" :: waited 0.031s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:34:00 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f46ff6-4fb9-4530-a62a-b475b594c4e2]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:34:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-956ce829-0935-4bff-a85a-94b3926bb063 tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:00 devstack sudo[91763]: pam_unix(sudo:session): session closed for user root Sep 10 15:34:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_ljlbwgx8devstack@QuobyteHD" returned: 0 in 3.840s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:34:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:34:01 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2017156237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31a17420-e1ca-4ba7-b09b-4b20149a33de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='084ea203476a4782a75056e007c7b628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:33:52Z,use_quota=True,user_id='022953e4e34b4c92aad66dea54350361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:34:01 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Creating volume 31a17420-e1ca-4ba7-b09b-4b20149a33de {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:34:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:34:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:34:01 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:34:01 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:34:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:34:01 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:34:01 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:34:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31a17420-e1ca-4ba7-b09b-4b20149a33de 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:01 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=52, name=volume-31a17420-e1ca-4ba7-b09b-4b20149a33de, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:34:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-956ce829-0935-4bff-a85a-94b3926bb063 tempest-SnapshotsActionsTest-399065424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b" returned: 0 in 0.681s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-956ce829-0935-4bff-a85a-94b3926bb063 tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31a17420-e1ca-4ba7-b09b-4b20149a33de 1073741824" returned: 0 in 0.535s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31a17420-e1ca-4ba7-b09b-4b20149a33de {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-956ce829-0935-4bff-a85a-94b3926bb063 tempest-SnapshotsActionsTest-399065424 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b" returned: 0 in 0.303s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-956ce829-0935-4bff-a85a-94b3926bb063 tempest-SnapshotsActionsTest-399065424 None] Lock "cinder-quobyte-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b" released by "delete_volume" :: held 1.292s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:34:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31a17420-e1ca-4ba7-b09b-4b20149a33de" returned: 0 in 0.427s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:02 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] <== create_volume: return (1059ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:34:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:34:02 devstack cinder-volume[82800]: DEBUG cinder.volume.volume_utils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Attempting download of aa69f997-7136-4bd6-b8ef-95a111ba2ea1 ((None, None)) to volume 31a17420-e1ca-4ba7-b09b-4b20149a33de. {{(pid=82800) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 15:34:02 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-956ce829-0935-4bff-a85a-94b3926bb063 tempest-SnapshotsActionsTest-399065424 None] Created reservations ['695b5b4c-1cea-405a-81bb-feac7d63b449', 'f9c75fcd-4194-4afc-b9af-7217734cb8e5', 'e16c7cc7-9b96-4b58-8c59-5ef3d6768a11', '7502b761-9a02-46ae-998b-6d759bd2b569'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:34:02 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bd6baf-c40a-4d1e-aca5-18a85af10f79]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:34:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_8q5gkgvh {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-956ce829-0935-4bff-a85a-94b3926bb063 tempest-SnapshotsActionsTest-399065424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:34:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-956ce829-0935-4bff-a85a-94b3926bb063 tempest-SnapshotsActionsTest-399065424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:34:02 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-956ce829-0935-4bff-a85a-94b3926bb063 tempest-SnapshotsActionsTest-399065424 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:34:02 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-956ce829-0935-4bff-a85a-94b3926bb063 tempest-SnapshotsActionsTest-399065424 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:34:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-956ce829-0935-4bff-a85a-94b3926bb063 tempest-SnapshotsActionsTest-399065424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:34:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-956ce829-0935-4bff-a85a-94b3926bb063 tempest-SnapshotsActionsTest-399065424 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_8q5gkgvh" returned: 0 in 0.577s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_8q5gkgvh {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-956ce829-0935-4bff-a85a-94b3926bb063 tempest-SnapshotsActionsTest-399065424 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.205s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:03 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-956ce829-0935-4bff-a85a-94b3926bb063 tempest-SnapshotsActionsTest-399065424 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:34:03 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-956ce829-0935-4bff-a85a-94b3926bb063 tempest-SnapshotsActionsTest-399065424 None] Deleted volume successfully. Sep 10 15:34:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-956ce829-0935-4bff-a85a-94b3926bb063 tempest-SnapshotsActionsTest-399065424 None] Lock "cinder-e1bd77a4-2cdc-42d2-918a-559f9af3aa5b-delete_volume" released by "delete_volume" :: held 3.037s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:34:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_8q5gkgvh" returned: 1 in 0.568s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_8q5gkgvh' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:34:03 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c63d5aa-ba09-4ef7-aef3-bf8c8976f547]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:34:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_ljlbwgx8devstack@QuobyteHD {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_ljlbwgx8devstack@QuobyteHD" returned: 0 in 0.412s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:04 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] aa69f997-7136-4bd6-b8ef-95a111ba2ea1 was qcow2, converting to raw {{(pid=82800) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 15:34:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_ljlbwgx8devstack@QuobyteHD /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31a17420-e1ca-4ba7-b09b-4b20149a33de {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:04 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=52, name=volume-31a17420-e1ca-4ba7-b09b-4b20149a33de, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:34:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_ljlbwgx8devstack@QuobyteHD /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31a17420-e1ca-4ba7-b09b-4b20149a33de" returned: 0 in 1.301s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:05 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_ljlbwgx8devstack@QuobyteHD, size 112.00 MB, duration 1.34 sec, destination /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31a17420-e1ca-4ba7-b09b-4b20149a33de {{(pid=82800) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 15:34:05 devstack cinder-volume[82800]: INFO cinder.image.image_utils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Converted 112.00 MB image at 83.45 MB/s Sep 10 15:34:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31a17420-e1ca-4ba7-b09b-4b20149a33de 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:05 devstack quobyte-client[82814]: System call of process 91811 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:34:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31a17420-e1ca-4ba7-b09b-4b20149a33de 1G" returned: 0 in 0.203s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:05 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[21902882-36ca-4222-b7d8-88d88b7918e8]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:34:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31a17420-e1ca-4ba7-b09b-4b20149a33de {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:06 devstack quobyte-client[82814]: System call of process 91814 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:34:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31a17420-e1ca-4ba7-b09b-4b20149a33de" returned: 0 in 0.437s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31a17420-e1ca-4ba7-b09b-4b20149a33de {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31a17420-e1ca-4ba7-b09b-4b20149a33de" returned: 1 in 0.692s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31a17420-e1ca-4ba7-b09b-4b20149a33de' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:34:07 devstack cinder-volume[82800]: DEBUG cinder.volume.volume_utils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Downloaded image aa69f997-7136-4bd6-b8ef-95a111ba2ea1 ((None, None)) to volume 31a17420-e1ca-4ba7-b09b-4b20149a33de successfully. {{(pid=82800) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 15:34:07 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Temporary image aa69f997-7136-4bd6-b8ef-95a111ba2ea1 for user 022953e4e34b4c92aad66dea54350361 is deleted. {{(pid=82800) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 15:34:07 devstack cinder-volume[82800]: DEBUG cinder.volume.volume_utils [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Marking volume 31a17420-e1ca-4ba7-b09b-4b20149a33de as bootable. {{(pid=82800) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 15:34:07 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Copying metadata from image aa69f997-7136-4bd6-b8ef-95a111ba2ea1 to 31a17420-e1ca-4ba7-b09b-4b20149a33de. {{(pid=82800) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 15:34:07 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Creating volume glance metadata for volume 31a17420-e1ca-4ba7-b09b-4b20149a33de backed by image aa69f997-7136-4bd6-b8ef-95a111ba2ea1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82800) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 15:34:07 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2766210b-868c-4e50-98c1-942919003f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31a17420-e1ca-4ba7-b09b-4b20149a33de', 'volume_size': 1, 'image_id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd75fe9cbcc7343938450d0505f3f0f02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'created_at': datetime.datetime(2025, 9, 10, 13, 6, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 13, 6, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa69f997-7136-4bd6-b8ef-95a111ba2ea1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:07 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360c0a59-3039-413d-9c54-a021a8848720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:07 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Volume volume-31a17420-e1ca-4ba7-b09b-4b20149a33de (31a17420-e1ca-4ba7-b09b-4b20149a33de): created successfully Sep 10 15:34:07 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360c0a59-3039-413d-9c54-a021a8848720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:07 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Flow 'volume_create_manager' (fb68ef00-c3aa-447c-beac-9ece2da165d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:34:07 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-f120bb78-2f5d-471d-8610-1b9fab0481c7 tempest-VolumesImageMetadata-13831497 None] Created volume successfully. Sep 10 15:34:09 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-99f4665b-5636-4bf2-8bdb-0091a96e8498 tempest-VolumesImageMetadata-13831497 None] Acquiring lock "cinder-31a17420-e1ca-4ba7-b09b-4b20149a33de-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:34:09 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-99f4665b-5636-4bf2-8bdb-0091a96e8498 tempest-VolumesImageMetadata-13831497 None] Lock "cinder-31a17420-e1ca-4ba7-b09b-4b20149a33de-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:34:10 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-99f4665b-5636-4bf2-8bdb-0091a96e8498 tempest-VolumesImageMetadata-13831497 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:34:10 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-99f4665b-5636-4bf2-8bdb-0091a96e8498 tempest-VolumesImageMetadata-13831497 None] Acquiring lock "cinder-quobyte-31a17420-e1ca-4ba7-b09b-4b20149a33de" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:34:10 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-99f4665b-5636-4bf2-8bdb-0091a96e8498 tempest-VolumesImageMetadata-13831497 None] Lock "cinder-quobyte-31a17420-e1ca-4ba7-b09b-4b20149a33de" acquired by "delete_volume" :: waited 0.021s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:34:10 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5316f98-922f-4c45-8d1e-a992f1959326]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:34:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-99f4665b-5636-4bf2-8bdb-0091a96e8498 tempest-VolumesImageMetadata-13831497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31a17420-e1ca-4ba7-b09b-4b20149a33de {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:10 devstack quobyte-client[82814]: System call of process 91833 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:34:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-99f4665b-5636-4bf2-8bdb-0091a96e8498 tempest-VolumesImageMetadata-13831497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31a17420-e1ca-4ba7-b09b-4b20149a33de" returned: 0 in 0.627s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-99f4665b-5636-4bf2-8bdb-0091a96e8498 tempest-VolumesImageMetadata-13831497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31a17420-e1ca-4ba7-b09b-4b20149a33de {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:11 devstack quobyte-client[82814]: System call of process 91838 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:34:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-99f4665b-5636-4bf2-8bdb-0091a96e8498 tempest-VolumesImageMetadata-13831497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31a17420-e1ca-4ba7-b09b-4b20149a33de" returned: 1 in 0.563s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-99f4665b-5636-4bf2-8bdb-0091a96e8498 tempest-VolumesImageMetadata-13831497 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31a17420-e1ca-4ba7-b09b-4b20149a33de' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:34:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-99f4665b-5636-4bf2-8bdb-0091a96e8498 tempest-VolumesImageMetadata-13831497 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31a17420-e1ca-4ba7-b09b-4b20149a33de {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-99f4665b-5636-4bf2-8bdb-0091a96e8498 tempest-VolumesImageMetadata-13831497 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-31a17420-e1ca-4ba7-b09b-4b20149a33de" returned: 0 in 0.126s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:11 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-99f4665b-5636-4bf2-8bdb-0091a96e8498 tempest-VolumesImageMetadata-13831497 None] Lock "cinder-quobyte-31a17420-e1ca-4ba7-b09b-4b20149a33de" released by "delete_volume" :: held 1.645s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:34:12 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-99f4665b-5636-4bf2-8bdb-0091a96e8498 tempest-VolumesImageMetadata-13831497 None] Created reservations ['75c62df8-1c3f-4ec9-a999-f01a9aee2342', 'c2515a0e-972d-4974-9755-a34b988dfc87', '75df84fb-de3e-4bc3-ac22-b5f0eaf724ae', '24351248-93a8-4ac5-8be0-b5efac8a6052'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:34:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-99f4665b-5636-4bf2-8bdb-0091a96e8498 tempest-VolumesImageMetadata-13831497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:34:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-99f4665b-5636-4bf2-8bdb-0091a96e8498 tempest-VolumesImageMetadata-13831497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:34:12 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-99f4665b-5636-4bf2-8bdb-0091a96e8498 tempest-VolumesImageMetadata-13831497 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:34:12 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-99f4665b-5636-4bf2-8bdb-0091a96e8498 tempest-VolumesImageMetadata-13831497 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:34:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-99f4665b-5636-4bf2-8bdb-0091a96e8498 tempest-VolumesImageMetadata-13831497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:34:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-99f4665b-5636-4bf2-8bdb-0091a96e8498 tempest-VolumesImageMetadata-13831497 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-99f4665b-5636-4bf2-8bdb-0091a96e8498 tempest-VolumesImageMetadata-13831497 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.231s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:12 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-99f4665b-5636-4bf2-8bdb-0091a96e8498 tempest-VolumesImageMetadata-13831497 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:34:12 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-99f4665b-5636-4bf2-8bdb-0091a96e8498 tempest-VolumesImageMetadata-13831497 None] Deleted volume successfully. Sep 10 15:34:13 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-99f4665b-5636-4bf2-8bdb-0091a96e8498 tempest-VolumesImageMetadata-13831497 None] Lock "cinder-31a17420-e1ca-4ba7-b09b-4b20149a33de-delete_volume" released by "delete_volume" :: held 3.164s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:34:19 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:34:19 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:34:19 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Flow 'volume_create_manager' (a7d20840-723a-44b6-8929-2755b1e09a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:34:19 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9af5e1b-f92f-42d6-a7bd-9c4d87b8cfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9af5e1b-f92f-42d6-a7bd-9c4d87b8cfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-887889195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a260f3f2-a0d8-49c0-ae47-e741d7868882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b28695a772cf458c8ff8838217e43066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:34:20Z,use_quota=True,user_id='282e83dd8b9e455cb96214563e5d6d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (696f0421-0e51-43b0-8721-0f4c0a225221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (696f0421-0e51-43b0-8721-0f4c0a225221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4801be78-b19f-46d8-96a5-003e6e222d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4801be78-b19f-46d8-96a5-003e6e222d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a260f3f2-a0d8-49c0-ae47-e741d7868882', 'volume_name': 'volume-a260f3f2-a0d8-49c0-ae47-e741d7868882', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf918b2-25bb-4374-858f-b1f863dd8048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf918b2-25bb-4374-858f-b1f863dd8048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a68ab58-6c72-4245-bbe5-7c8ab7fa2755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:20 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Volume a260f3f2-a0d8-49c0-ae47-e741d7868882: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a260f3f2-a0d8-49c0-ae47-e741d7868882', 'volume_size': 1} Sep 10 15:34:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:34:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:34:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-887889195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a260f3f2-a0d8-49c0-ae47-e741d7868882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b28695a772cf458c8ff8838217e43066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:34:20Z,use_quota=True,user_id='282e83dd8b9e455cb96214563e5d6d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:34:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Creating volume a260f3f2-a0d8-49c0-ae47-e741d7868882 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:34:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:34:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:34:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:34:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:34:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:34:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:34:20 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:34:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-a260f3f2-a0d8-49c0-ae47-e741d7868882 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:20 devstack quobyte-client[82814]: System call of process 91881 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:34:20 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=53, name=volume-a260f3f2-a0d8-49c0-ae47-e741d7868882, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:34:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-a260f3f2-a0d8-49c0-ae47-e741d7868882 1073741824" returned: 0 in 0.518s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-a260f3f2-a0d8-49c0-ae47-e741d7868882 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-a260f3f2-a0d8-49c0-ae47-e741d7868882" returned: 0 in 0.178s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] <== create_volume: return (773ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:34:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:34:21 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=50,cinder:UPDATE=54,cinder:DELETE=4,cinder:INSERT=17 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:34:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a68ab58-6c72-4245-bbe5-7c8ab7fa2755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a260f3f2-a0d8-49c0-ae47-e741d7868882', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48221d2a-9c19-494c-8e48-7b616e185668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:21 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:DELETE=4,cinder:SELECT=46,cinder:INSERT=24,cinder:UPDATE=51 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:34:21 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Volume volume-a260f3f2-a0d8-49c0-ae47-e741d7868882 (a260f3f2-a0d8-49c0-ae47-e741d7868882): created successfully Sep 10 15:34:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48221d2a-9c19-494c-8e48-7b616e185668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Flow 'volume_create_manager' (a7d20840-723a-44b6-8929-2755b1e09a66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:34:21 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-26e5d28d-e2f1-410a-bbc6-7e156788fe86 tempest-AbsoluteLimitsTests-1588380075 None] Created volume successfully. Sep 10 15:34:22 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-f3a91c48-b706-44a7-8875-d0f18aefb3fb tempest-AbsoluteLimitsTests-1588380075 None] Acquiring lock "cinder-a260f3f2-a0d8-49c0-ae47-e741d7868882-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:34:22 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-f3a91c48-b706-44a7-8875-d0f18aefb3fb tempest-AbsoluteLimitsTests-1588380075 None] Lock "cinder-a260f3f2-a0d8-49c0-ae47-e741d7868882-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:34:22 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-f3a91c48-b706-44a7-8875-d0f18aefb3fb tempest-AbsoluteLimitsTests-1588380075 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:34:22 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-f3a91c48-b706-44a7-8875-d0f18aefb3fb tempest-AbsoluteLimitsTests-1588380075 None] Acquiring lock "cinder-quobyte-a260f3f2-a0d8-49c0-ae47-e741d7868882" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:34:22 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-f3a91c48-b706-44a7-8875-d0f18aefb3fb tempest-AbsoluteLimitsTests-1588380075 None] Lock "cinder-quobyte-a260f3f2-a0d8-49c0-ae47-e741d7868882" acquired by "delete_volume" :: waited 0.017s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:34:22 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[000739d4-977d-4463-afe0-36bf0038d08b]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:34:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f3a91c48-b706-44a7-8875-d0f18aefb3fb tempest-AbsoluteLimitsTests-1588380075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-a260f3f2-a0d8-49c0-ae47-e741d7868882 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f3a91c48-b706-44a7-8875-d0f18aefb3fb tempest-AbsoluteLimitsTests-1588380075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-a260f3f2-a0d8-49c0-ae47-e741d7868882" returned: 0 in 0.551s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f3a91c48-b706-44a7-8875-d0f18aefb3fb tempest-AbsoluteLimitsTests-1588380075 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-a260f3f2-a0d8-49c0-ae47-e741d7868882 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f3a91c48-b706-44a7-8875-d0f18aefb3fb tempest-AbsoluteLimitsTests-1588380075 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-a260f3f2-a0d8-49c0-ae47-e741d7868882" returned: 0 in 0.124s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:23 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-f3a91c48-b706-44a7-8875-d0f18aefb3fb tempest-AbsoluteLimitsTests-1588380075 None] Lock "cinder-quobyte-a260f3f2-a0d8-49c0-ae47-e741d7868882" released by "delete_volume" :: held 0.971s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:34:24 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-f3a91c48-b706-44a7-8875-d0f18aefb3fb tempest-AbsoluteLimitsTests-1588380075 None] Created reservations ['0999cff9-1d47-47ca-8c3d-3f6ff3e6f72a', 'c52f9c76-11c4-425f-90ea-ed1a2e10857f', 'e1b442da-26b7-4a9f-a2c4-267c53c0126f', 'faf667b3-8ae1-4b9c-a8e6-2c82303bb458'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:34:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f3a91c48-b706-44a7-8875-d0f18aefb3fb tempest-AbsoluteLimitsTests-1588380075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:34:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f3a91c48-b706-44a7-8875-d0f18aefb3fb tempest-AbsoluteLimitsTests-1588380075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:34:24 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f3a91c48-b706-44a7-8875-d0f18aefb3fb tempest-AbsoluteLimitsTests-1588380075 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:34:24 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f3a91c48-b706-44a7-8875-d0f18aefb3fb tempest-AbsoluteLimitsTests-1588380075 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:34:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f3a91c48-b706-44a7-8875-d0f18aefb3fb tempest-AbsoluteLimitsTests-1588380075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:34:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f3a91c48-b706-44a7-8875-d0f18aefb3fb tempest-AbsoluteLimitsTests-1588380075 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f3a91c48-b706-44a7-8875-d0f18aefb3fb tempest-AbsoluteLimitsTests-1588380075 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.149s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:24 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-f3a91c48-b706-44a7-8875-d0f18aefb3fb tempest-AbsoluteLimitsTests-1588380075 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:34:24 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-f3a91c48-b706-44a7-8875-d0f18aefb3fb tempest-AbsoluteLimitsTests-1588380075 None] Deleted volume successfully. Sep 10 15:34:25 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-f3a91c48-b706-44a7-8875-d0f18aefb3fb tempest-AbsoluteLimitsTests-1588380075 None] Lock "cinder-a260f3f2-a0d8-49c0-ae47-e741d7868882-delete_volume" released by "delete_volume" :: held 2.749s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:34:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:34:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:34:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:34:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:34:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:34:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:34:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.273s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:34:30 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:34:30 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:34:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Flow 'volume_create_manager' (673fe6dd-cd87-4fe6-95e2-bd10ce7c61b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:34:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (219e3901-97e0-4065-ab44-587941dc1f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (219e3901-97e0-4065-ab44-587941dc1f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-772789902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=580e3e7d-9925-40dd-b9ff-6f2c39b585cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9d906d00c7646979fa02dbfdd95ae5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:34:31Z,use_quota=True,user_id='14d1a6101d8b4633a6790929f16d6b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5218756-4073-4af3-81c6-932c7ecac6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5218756-4073-4af3-81c6-932c7ecac6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3b035a-0a15-44cb-b5b2-658350c399e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3b035a-0a15-44cb-b5b2-658350c399e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '580e3e7d-9925-40dd-b9ff-6f2c39b585cc', 'volume_name': 'volume-580e3e7d-9925-40dd-b9ff-6f2c39b585cc', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c0d804c-8c83-4dbd-b495-87d46be9c40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c0d804c-8c83-4dbd-b495-87d46be9c40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16c6b79-efb1-4ca2-8fd4-31249f77dd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:31 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Volume 580e3e7d-9925-40dd-b9ff-6f2c39b585cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-580e3e7d-9925-40dd-b9ff-6f2c39b585cc', 'volume_size': 1} Sep 10 15:34:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:34:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:34:31 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:34:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-772789902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=580e3e7d-9925-40dd-b9ff-6f2c39b585cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9d906d00c7646979fa02dbfdd95ae5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:34:31Z,use_quota=True,user_id='14d1a6101d8b4633a6790929f16d6b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:34:31 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Creating volume 580e3e7d-9925-40dd-b9ff-6f2c39b585cc {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:34:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:34:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:34:31 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:34:31 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:34:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:34:31 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:34:31 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:34:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-580e3e7d-9925-40dd-b9ff-6f2c39b585cc 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:31 devstack quobyte-client[82814]: System call of process 91895 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:34:31 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=54, name=volume-580e3e7d-9925-40dd-b9ff-6f2c39b585cc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:34:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-580e3e7d-9925-40dd-b9ff-6f2c39b585cc 1073741824" returned: 0 in 0.508s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-580e3e7d-9925-40dd-b9ff-6f2c39b585cc {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-580e3e7d-9925-40dd-b9ff-6f2c39b585cc" returned: 0 in 0.226s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] <== create_volume: return (811ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:34:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:34:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16c6b79-efb1-4ca2-8fd4-31249f77dd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-580e3e7d-9925-40dd-b9ff-6f2c39b585cc', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c1733e-f608-40c6-a420-0e0c19d89d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:32 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Volume volume-580e3e7d-9925-40dd-b9ff-6f2c39b585cc (580e3e7d-9925-40dd-b9ff-6f2c39b585cc): created successfully Sep 10 15:34:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c1733e-f608-40c6-a420-0e0c19d89d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Flow 'volume_create_manager' (673fe6dd-cd87-4fe6-95e2-bd10ce7c61b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:34:32 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-c7e5c1ee-6e50-47a1-8e17-03141dfaeca4 tempest-AttachVolumeNegativeTest-150614502 None] Created volume successfully. Sep 10 15:34:34 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:34:34 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:34:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Flow 'volume_create_manager' (297784b5-5187-41ee-aa8f-1cca5056e59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:34:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (223294a6-f797-4b3a-ada7-3b6ad19ef9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (223294a6-f797-4b3a-ada7-3b6ad19ef9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-39198558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=515db04d-0c15-49f7-8a2c-874e5de061a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb954e91e8874b5ba34ca0c4e732facf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:34:34Z,use_quota=True,user_id='0a2705a242834df9b271f5cc3c57060f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6088bf9a-52dd-4b72-a2d2-920dba841a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6088bf9a-52dd-4b72-a2d2-920dba841a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49cd42a-9516-48bd-93be-7d627d0c945b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49cd42a-9516-48bd-93be-7d627d0c945b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '515db04d-0c15-49f7-8a2c-874e5de061a5', 'volume_name': 'volume-515db04d-0c15-49f7-8a2c-874e5de061a5', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52209964-d61c-4b8e-be3e-1175350078d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52209964-d61c-4b8e-be3e-1175350078d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e68c880c-9bbc-49a1-ad13-dd3e40d0846f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:34 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Volume 515db04d-0c15-49f7-8a2c-874e5de061a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-515db04d-0c15-49f7-8a2c-874e5de061a5', 'volume_size': 1} Sep 10 15:34:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:34:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:34:34 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-39198558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=515db04d-0c15-49f7-8a2c-874e5de061a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb954e91e8874b5ba34ca0c4e732facf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:34:34Z,use_quota=True,user_id='0a2705a242834df9b271f5cc3c57060f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:34:34 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Creating volume 515db04d-0c15-49f7-8a2c-874e5de061a5 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:34:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:34:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:34:34 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:34:34 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:34:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:34:34 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:34:34 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:34:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:34 devstack quobyte-client[82814]: System call of process 91899 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:34:34 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=55, name=volume-515db04d-0c15-49f7-8a2c-874e5de061a5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:34:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5 1073741824" returned: 0 in 0.414s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5" returned: 0 in 0.116s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:35 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] <== create_volume: return (644ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:34:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.656s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:34:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e68c880c-9bbc-49a1-ad13-dd3e40d0846f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-515db04d-0c15-49f7-8a2c-874e5de061a5', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1349bb15-ac19-4189-a81e-c435a3d0bf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:35 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Volume volume-515db04d-0c15-49f7-8a2c-874e5de061a5 (515db04d-0c15-49f7-8a2c-874e5de061a5): created successfully Sep 10 15:34:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1349bb15-ac19-4189-a81e-c435a3d0bf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Flow 'volume_create_manager' (297784b5-5187-41ee-aa8f-1cca5056e59d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:34:35 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-d3bcdae7-4cdb-4764-a1d6-98dff21ea703 tempest-VolumesDeleteCascade-875122981 None] Created volume successfully. Sep 10 15:34:36 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-ad23ba9c-4cb1-45c0-b539-1487ac2344a5 tempest-VolumesDeleteCascade-875122981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:34:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ad23ba9c-4cb1-45c0-b539-1487ac2344a5 tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:34:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ad23ba9c-4cb1-45c0-b539-1487ac2344a5 tempest-VolumesDeleteCascade-875122981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:34:36 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-ad23ba9c-4cb1-45c0-b539-1487ac2344a5 tempest-VolumesDeleteCascade-875122981 None] Creating offline snapshot 9507eac3-8701-4e59-acf2-6b8bbeb68acd of volume 515db04d-0c15-49f7-8a2c-874e5de061a5 {{(pid=82800) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 15:34:37 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7cea99-23ca-49b3-8f96-72f33b198449]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:34:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ad23ba9c-4cb1-45c0-b539-1487ac2344a5 tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-cae70785-21a7-40d0-a384-be452cb15d6d req-a319cd7d-ff4a-4dbc-997d-0837b166fc37 tempest-AttachVolumeNegativeTest-150614502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:34:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ad23ba9c-4cb1-45c0-b539-1487ac2344a5 tempest-VolumesDeleteCascade-875122981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5" returned: 0 in 1.089s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ad23ba9c-4cb1-45c0-b539-1487ac2344a5 tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:38 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=56, name=volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:34:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ad23ba9c-4cb1-45c0-b539-1487ac2344a5 tempest-VolumesDeleteCascade-875122981 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd 1G" returned: 0 in 0.273s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ad23ba9c-4cb1-45c0-b539-1487ac2344a5 tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): qemu-img rebase -u -b volume-515db04d-0c15-49f7-8a2c-874e5de061a5 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ad23ba9c-4cb1-45c0-b539-1487ac2344a5 tempest-VolumesDeleteCascade-875122981 None] CMD "qemu-img rebase -u -b volume-515db04d-0c15-49f7-8a2c-874e5de061a5 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd" returned: 0 in 0.180s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:38 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-ad23ba9c-4cb1-45c0-b539-1487ac2344a5 tempest-VolumesDeleteCascade-875122981 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:34:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ad23ba9c-4cb1-45c0-b539-1487ac2344a5 tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ad23ba9c-4cb1-45c0-b539-1487ac2344a5 tempest-VolumesDeleteCascade-875122981 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd" returned: 0 in 0.112s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:38 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-ad23ba9c-4cb1-45c0-b539-1487ac2344a5 tempest-VolumesDeleteCascade-875122981 None] Setting permissions: /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5 -> 1000:1000 {{(pid=82800) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 15:34:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ad23ba9c-4cb1-45c0-b539-1487ac2344a5 tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ad23ba9c-4cb1-45c0-b539-1487ac2344a5 tempest-VolumesDeleteCascade-875122981 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd" returned: 0 in 0.123s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ad23ba9c-4cb1-45c0-b539-1487ac2344a5 tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ad23ba9c-4cb1-45c0-b539-1487ac2344a5 tempest-VolumesDeleteCascade-875122981 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.info" returned: 0 in 0.120s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:39 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-ad23ba9c-4cb1-45c0-b539-1487ac2344a5 tempest-VolumesDeleteCascade-875122981 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.info is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:34:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ad23ba9c-4cb1-45c0-b539-1487ac2344a5 tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ad23ba9c-4cb1-45c0-b539-1487ac2344a5 tempest-VolumesDeleteCascade-875122981 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.info" returned: 0 in 0.104s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ad23ba9c-4cb1-45c0-b539-1487ac2344a5 tempest-VolumesDeleteCascade-875122981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.501s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:34:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-cae70785-21a7-40d0-a384-be452cb15d6d req-a319cd7d-ff4a-4dbc-997d-0837b166fc37 tempest-AttachVolumeNegativeTest-150614502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.458s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:34:39 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25a4cb1-60d8-41d9-b3b2-069b18e99ff0]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:34:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-cae70785-21a7-40d0-a384-be452cb15d6d req-a319cd7d-ff4a-4dbc-997d-0837b166fc37 tempest-AttachVolumeNegativeTest-150614502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-580e3e7d-9925-40dd-b9ff-6f2c39b585cc {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:39 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-ad23ba9c-4cb1-45c0-b539-1487ac2344a5 tempest-VolumesDeleteCascade-875122981 None] Create snapshot completed successfully Sep 10 15:34:40 devstack quobyte-client[82814]: System call of process 91925 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:34:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-cae70785-21a7-40d0-a384-be452cb15d6d req-a319cd7d-ff4a-4dbc-997d-0837b166fc37 tempest-AttachVolumeNegativeTest-150614502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-580e3e7d-9925-40dd-b9ff-6f2c39b585cc" returned: 0 in 0.636s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-cae70785-21a7-40d0-a384-be452cb15d6d req-a319cd7d-ff4a-4dbc-997d-0837b166fc37 tempest-AttachVolumeNegativeTest-150614502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.719s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:34:40 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-df95e7fb-443d-4fba-a06e-23fa76b80d3e tempest-VolumesDeleteCascade-875122981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:34:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-df95e7fb-443d-4fba-a06e-23fa76b80d3e tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:34:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-df95e7fb-443d-4fba-a06e-23fa76b80d3e tempest-VolumesDeleteCascade-875122981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:34:40 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-df95e7fb-443d-4fba-a06e-23fa76b80d3e tempest-VolumesDeleteCascade-875122981 None] Creating offline snapshot 303d819b-1c61-4cdf-bd89-231ac01629e3 of volume 515db04d-0c15-49f7-8a2c-874e5de061a5 {{(pid=82800) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 15:34:40 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-cae70785-21a7-40d0-a384-be452cb15d6d req-a319cd7d-ff4a-4dbc-997d-0837b166fc37 tempest-AttachVolumeNegativeTest-150614502 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5', 'name': 'volume-580e3e7d-9925-40dd-b9ff-6f2c39b585cc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba52f966-8e67-447e-a34c-b0535ee7c4c6', 'enforce_multipath': True} {{(pid=82800) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 15:34:40 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-cae70785-21a7-40d0-a384-be452cb15d6d req-a319cd7d-ff4a-4dbc-997d-0837b166fc37 tempest-AttachVolumeNegativeTest-150614502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:34:40 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[77730650-0e21-4a5f-8439-e073edca1ae4]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:34:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-df95e7fb-443d-4fba-a06e-23fa76b80d3e tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:41 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-cae70785-21a7-40d0-a384-be452cb15d6d req-a319cd7d-ff4a-4dbc-997d-0837b166fc37 tempest-AttachVolumeNegativeTest-150614502 None] attachment_update completed successfully. Sep 10 15:34:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-df95e7fb-443d-4fba-a06e-23fa76b80d3e tempest-VolumesDeleteCascade-875122981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd" returned: 0 in 0.654s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:41 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-df95e7fb-443d-4fba-a06e-23fa76b80d3e tempest-VolumesDeleteCascade-875122981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-515db04d-0c15-49f7-8a2c-874e5de061a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:34:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-df95e7fb-443d-4fba-a06e-23fa76b80d3e tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.303d819b-1c61-4cdf-bd89-231ac01629e3 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:41 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=58, name=volume-515db04d-0c15-49f7-8a2c-874e5de061a5.303d819b-1c61-4cdf-bd89-231ac01629e3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:34:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-df95e7fb-443d-4fba-a06e-23fa76b80d3e tempest-VolumesDeleteCascade-875122981 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.303d819b-1c61-4cdf-bd89-231ac01629e3 1G" returned: 0 in 0.429s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-df95e7fb-443d-4fba-a06e-23fa76b80d3e tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): qemu-img rebase -u -b volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.303d819b-1c61-4cdf-bd89-231ac01629e3 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:41 devstack quobyte-client[82814]: System call of process 91936 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:34:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-df95e7fb-443d-4fba-a06e-23fa76b80d3e tempest-VolumesDeleteCascade-875122981 None] CMD "qemu-img rebase -u -b volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.303d819b-1c61-4cdf-bd89-231ac01629e3" returned: 0 in 0.575s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:42 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-df95e7fb-443d-4fba-a06e-23fa76b80d3e tempest-VolumesDeleteCascade-875122981 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.303d819b-1c61-4cdf-bd89-231ac01629e3 is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:34:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-df95e7fb-443d-4fba-a06e-23fa76b80d3e tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.303d819b-1c61-4cdf-bd89-231ac01629e3 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:42 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:34:42 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:34:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Flow 'volume_create_manager' (acc825d6-8405-448e-a33c-5119b02abacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:34:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1571afb8-132f-4f3e-a9db-078ac8e14577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-df95e7fb-443d-4fba-a06e-23fa76b80d3e tempest-VolumesDeleteCascade-875122981 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.303d819b-1c61-4cdf-bd89-231ac01629e3" returned: 0 in 0.419s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1571afb8-132f-4f3e-a9db-078ac8e14577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1533523854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfd3a3c7-5d7b-485d-b0e0-96c272bbfc60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c7a26343c549b4a96beb69ae1abeab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:34:42Z,use_quota=True,user_id='769cf7cbe9dd45bf879793561808c083',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0a1a042-39ee-49a5-9563-5c02a4a0101d),volume_type_id=e0a1a042-39ee-49a5-9563-5c02a4a0101d)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31dd1e8-772f-40ee-b593-0a081ffafd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31dd1e8-772f-40ee-b593-0a081ffafd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd995480-ed95-4920-9140-e0dcd4f3b856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd995480-ed95-4920-9140-e0dcd4f3b856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfd3a3c7-5d7b-485d-b0e0-96c272bbfc60', 'volume_name': 'volume-cfd3a3c7-5d7b-485d-b0e0-96c272bbfc60', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac423a53-2c4f-4d45-8bf2-eb5bfb846a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac423a53-2c4f-4d45-8bf2-eb5bfb846a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30029801-05fd-4383-bf8c-95a325b47bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:42 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Volume cfd3a3c7-5d7b-485d-b0e0-96c272bbfc60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfd3a3c7-5d7b-485d-b0e0-96c272bbfc60', 'volume_size': 1} Sep 10 15:34:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:34:42 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-df95e7fb-443d-4fba-a06e-23fa76b80d3e tempest-VolumesDeleteCascade-875122981 None] Setting permissions: /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd -> 1000:1000 {{(pid=82800) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 15:34:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-df95e7fb-443d-4fba-a06e-23fa76b80d3e tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.303d819b-1c61-4cdf-bd89-231ac01629e3 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-df95e7fb-443d-4fba-a06e-23fa76b80d3e tempest-VolumesDeleteCascade-875122981 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.303d819b-1c61-4cdf-bd89-231ac01629e3" returned: 0 in 0.124s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-df95e7fb-443d-4fba-a06e-23fa76b80d3e tempest-VolumesDeleteCascade-875122981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.541s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:34:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.298s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:34:43 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1533523854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfd3a3c7-5d7b-485d-b0e0-96c272bbfc60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c7a26343c549b4a96beb69ae1abeab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:34:42Z,use_quota=True,user_id='769cf7cbe9dd45bf879793561808c083',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0a1a042-39ee-49a5-9563-5c02a4a0101d),volume_type_id=e0a1a042-39ee-49a5-9563-5c02a4a0101d)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:34:43 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Creating volume cfd3a3c7-5d7b-485d-b0e0-96c272bbfc60 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:34:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:34:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:34:43 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:34:43 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:34:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:34:43 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:34:43 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:34:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-cfd3a3c7-5d7b-485d-b0e0-96c272bbfc60 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:43 devstack quobyte-client[82814]: System call of process 92063 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:34:43 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=59, name=volume-cfd3a3c7-5d7b-485d-b0e0-96c272bbfc60, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:34:43 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-df95e7fb-443d-4fba-a06e-23fa76b80d3e tempest-VolumesDeleteCascade-875122981 None] Create snapshot completed successfully Sep 10 15:34:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-cfd3a3c7-5d7b-485d-b0e0-96c272bbfc60 1073741824" returned: 0 in 0.596s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-cfd3a3c7-5d7b-485d-b0e0-96c272bbfc60 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-cfd3a3c7-5d7b-485d-b0e0-96c272bbfc60" returned: 0 in 0.154s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] <== create_volume: return (846ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:34:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:34:44 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "cinder-515db04d-0c15-49f7-8a2c-874e5de061a5-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:34:44 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30029801-05fd-4383-bf8c-95a325b47bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfd3a3c7-5d7b-485d-b0e0-96c272bbfc60', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:44 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72efc29a-82f0-4507-b999-11029ba31b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:44 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-515db04d-0c15-49f7-8a2c-874e5de061a5-delete_volume" acquired by "delete_volume" :: waited 0.154s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:34:44 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Volume volume-cfd3a3c7-5d7b-485d-b0e0-96c272bbfc60 (cfd3a3c7-5d7b-485d-b0e0-96c272bbfc60): created successfully Sep 10 15:34:44 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72efc29a-82f0-4507-b999-11029ba31b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:44 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Flow 'volume_create_manager' (acc825d6-8405-448e-a33c-5119b02abacc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:34:44 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-22e5e7c7-e043-4dcf-88a8-7cee13dc97fe tempest-VolumeTypesAccessTest-301739449 None] Created volume successfully. Sep 10 15:34:44 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:34:44 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Performing cascade delete. {{(pid=82800) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 10 15:34:44 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "cinder-303d819b-1c61-4cdf-bd89-231ac01629e3-delete_snapshot" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:34:44 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-303d819b-1c61-4cdf-bd89-231ac01629e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:34:44 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:34:44 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "cinder-quobyte-515db04d-0c15-49f7-8a2c-874e5de061a5" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:34:44 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-quobyte-515db04d-0c15-49f7-8a2c-874e5de061a5" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:34:44 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "cinder-quobyte-303d819b-1c61-4cdf-bd89-231ac01629e3" by "_delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:34:44 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-quobyte-303d819b-1c61-4cdf-bd89-231ac01629e3" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:34:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Deleting offline snapshot 303d819b-1c61-4cdf-bd89-231ac01629e3 of volume 515db04d-0c15-49f7-8a2c-874e5de061a5 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 15:34:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] snapshot_file for this snap is: volume-515db04d-0c15-49f7-8a2c-874e5de061a5.303d819b-1c61-4cdf-bd89-231ac01629e3 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 15:34:44 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7fc14f-700b-4ada-a332-32be800f3d5d]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:34:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.303d819b-1c61-4cdf-bd89-231ac01629e3 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:45 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b0febde3-ac76-438d-b96d-e12bb9aa0903 tempest-VolumeTypesAccessTest-301739449 None] Acquiring lock "cinder-cfd3a3c7-5d7b-485d-b0e0-96c272bbfc60-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:34:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.303d819b-1c61-4cdf-bd89-231ac01629e3" returned: 0 in 0.597s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:45 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-515db04d-0c15-49f7-8a2c-874e5de061a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:34:45 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b39ec6-57a7-452c-880c-551c00724f3d]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:34:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:45 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b0febde3-ac76-438d-b96d-e12bb9aa0903 tempest-VolumeTypesAccessTest-301739449 None] Lock "cinder-cfd3a3c7-5d7b-485d-b0e0-96c272bbfc60-delete_volume" acquired by "delete_volume" :: waited 0.212s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:34:46 devstack quobyte-client[82814]: System call of process 92334 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:34:46 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-b0febde3-ac76-438d-b96d-e12bb9aa0903 tempest-VolumeTypesAccessTest-301739449 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:34:46 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b0febde3-ac76-438d-b96d-e12bb9aa0903 tempest-VolumeTypesAccessTest-301739449 None] Acquiring lock "cinder-quobyte-cfd3a3c7-5d7b-485d-b0e0-96c272bbfc60" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:34:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd" returned: 0 in 0.545s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-515db04d-0c15-49f7-8a2c-874e5de061a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:34:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.303d819b-1c61-4cdf-bd89-231ac01629e3 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:46 devstack quobyte-client[82814]: System call of process 92337 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:34:46 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b0febde3-ac76-438d-b96d-e12bb9aa0903 tempest-VolumeTypesAccessTest-301739449 None] Lock "cinder-quobyte-cfd3a3c7-5d7b-485d-b0e0-96c272bbfc60" acquired by "delete_volume" :: waited 0.234s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:34:46 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55f0539-a17c-4213-a262-ac09f204de3c]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:34:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b0febde3-ac76-438d-b96d-e12bb9aa0903 tempest-VolumeTypesAccessTest-301739449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-cfd3a3c7-5d7b-485d-b0e0-96c272bbfc60 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.303d819b-1c61-4cdf-bd89-231ac01629e3" returned: 0 in 0.505s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.303d819b-1c61-4cdf-bd89-231ac01629e3 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.303d819b-1c61-4cdf-bd89-231ac01629e3" returned: 0 in 0.091s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:46 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-quobyte-303d819b-1c61-4cdf-bd89-231ac01629e3" released by "_delete_snapshot" :: held 1.996s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:34:46 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-quobyte-515db04d-0c15-49f7-8a2c-874e5de061a5" released by "delete_snapshot" :: held 2.018s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:34:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b0febde3-ac76-438d-b96d-e12bb9aa0903 tempest-VolumeTypesAccessTest-301739449 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-cfd3a3c7-5d7b-485d-b0e0-96c272bbfc60" returned: 0 in 0.804s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b0febde3-ac76-438d-b96d-e12bb9aa0903 tempest-VolumeTypesAccessTest-301739449 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-cfd3a3c7-5d7b-485d-b0e0-96c272bbfc60 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b0febde3-ac76-438d-b96d-e12bb9aa0903 tempest-VolumeTypesAccessTest-301739449 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-cfd3a3c7-5d7b-485d-b0e0-96c272bbfc60" returned: 0 in 0.237s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:47 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b0febde3-ac76-438d-b96d-e12bb9aa0903 tempest-VolumeTypesAccessTest-301739449 None] Lock "cinder-quobyte-cfd3a3c7-5d7b-485d-b0e0-96c272bbfc60" released by "delete_volume" :: held 1.266s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:34:47 devstack cinder-volume[82800]: WARNING cinder.quota [None req-b0febde3-ac76-438d-b96d-e12bb9aa0903 tempest-VolumeTypesAccessTest-301739449 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-868005188 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-868005188, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:34:47 devstack cinder-volume[82800]: WARNING cinder.quota [None req-b0febde3-ac76-438d-b96d-e12bb9aa0903 tempest-VolumeTypesAccessTest-301739449 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-868005188 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-868005188, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:34:47 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Created reservations ['1c0900f4-e65e-48a4-a25c-3d33ba695f09', '63762e26-3b68-4466-8450-c1c9e0101f0c', '6b620e99-09f7-495c-86cb-112cc3c3a7ba', 'bd6027d3-0bc2-4cf3-bafd-4d060bd15f2e'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:34:47 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-b0febde3-ac76-438d-b96d-e12bb9aa0903 tempest-VolumeTypesAccessTest-301739449 None] Created reservations ['9bb559e9-e24d-4f3a-8b52-59db07fc9607', '2f75f9fb-e5e9-4d30-9264-6873a2429197', 'f078357e-0102-49e2-98fd-71ccb1b2ff2e', '607a577e-78ef-49a0-9aed-390fc806b63e'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:34:47 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Delete snapshot completed successfully. Sep 10 15:34:47 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-303d819b-1c61-4cdf-bd89-231ac01629e3-delete_snapshot" released by "delete_snapshot" :: held 3.046s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:34:47 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "cinder-9507eac3-8701-4e59-acf2-6b8bbeb68acd-delete_snapshot" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:34:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b0febde3-ac76-438d-b96d-e12bb9aa0903 tempest-VolumeTypesAccessTest-301739449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:34:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b0febde3-ac76-438d-b96d-e12bb9aa0903 tempest-VolumeTypesAccessTest-301739449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:34:47 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b0febde3-ac76-438d-b96d-e12bb9aa0903 tempest-VolumeTypesAccessTest-301739449 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:34:47 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b0febde3-ac76-438d-b96d-e12bb9aa0903 tempest-VolumeTypesAccessTest-301739449 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:34:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b0febde3-ac76-438d-b96d-e12bb9aa0903 tempest-VolumeTypesAccessTest-301739449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:34:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b0febde3-ac76-438d-b96d-e12bb9aa0903 tempest-VolumeTypesAccessTest-301739449 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b0febde3-ac76-438d-b96d-e12bb9aa0903 tempest-VolumeTypesAccessTest-301739449 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.135s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:48 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-b0febde3-ac76-438d-b96d-e12bb9aa0903 tempest-VolumeTypesAccessTest-301739449 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:34:48 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-9507eac3-8701-4e59-acf2-6b8bbeb68acd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.234s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:34:48 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:34:48 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-b0febde3-ac76-438d-b96d-e12bb9aa0903 tempest-VolumeTypesAccessTest-301739449 None] Deleted volume successfully. Sep 10 15:34:48 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "cinder-quobyte-515db04d-0c15-49f7-8a2c-874e5de061a5" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:34:48 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b0febde3-ac76-438d-b96d-e12bb9aa0903 tempest-VolumeTypesAccessTest-301739449 None] Lock "cinder-cfd3a3c7-5d7b-485d-b0e0-96c272bbfc60-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:34:48 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-quobyte-515db04d-0c15-49f7-8a2c-874e5de061a5" acquired by "delete_snapshot" :: waited 0.033s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:34:48 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "cinder-quobyte-9507eac3-8701-4e59-acf2-6b8bbeb68acd" by "_delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:34:48 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-quobyte-9507eac3-8701-4e59-acf2-6b8bbeb68acd" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:34:48 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Deleting offline snapshot 9507eac3-8701-4e59-acf2-6b8bbeb68acd of volume 515db04d-0c15-49f7-8a2c-874e5de061a5 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 15:34:48 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] snapshot_file for this snap is: volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 15:34:48 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93a5de8-4408-4a95-9aa1-e51c87bf9611]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:34:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd" returned: 0 in 0.536s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:49 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-515db04d-0c15-49f7-8a2c-874e5de061a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:34:49 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[787b854c-c4b6-4b9a-b4d6-59bb67fc0a0b]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:34:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5" returned: 0 in 0.544s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd" returned: 0 in 0.334s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5.9507eac3-8701-4e59-acf2-6b8bbeb68acd" returned: 0 in 0.139s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:50 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-quobyte-9507eac3-8701-4e59-acf2-6b8bbeb68acd" released by "_delete_snapshot" :: held 2.019s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:34:50 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-quobyte-515db04d-0c15-49f7-8a2c-874e5de061a5" released by "delete_snapshot" :: held 2.045s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:34:51 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Created reservations ['2f8a9ebb-da02-433b-a279-cf5a74125d43', '781405d5-2ff5-4afd-87bd-cef05e8ba340', 'cedf00a8-716c-435a-9427-5cff878a1d4d', '1e6fd666-1c92-4bed-b960-dcd58fe03525'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:34:51 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Delete snapshot completed successfully. Sep 10 15:34:51 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-9507eac3-8701-4e59-acf2-6b8bbeb68acd-delete_snapshot" released by "delete_snapshot" :: held 3.538s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:34:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Snapshots deleted, issuing volume delete {{(pid=82800) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 10 15:34:51 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "cinder-quobyte-515db04d-0c15-49f7-8a2c-874e5de061a5" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:34:51 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-quobyte-515db04d-0c15-49f7-8a2c-874e5de061a5" acquired by "delete_volume" :: waited 0.029s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:34:51 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a00b5e-f427-48db-9a45-b1ed2e1f18fc]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:34:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5" returned: 0 in 0.583s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-515db04d-0c15-49f7-8a2c-874e5de061a5" returned: 0 in 0.203s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:52 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-quobyte-515db04d-0c15-49f7-8a2c-874e5de061a5" released by "delete_volume" :: held 0.993s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:34:53 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Created reservations ['4a0f4806-e99e-4f24-b437-eddb5d4dda89', 'be1fbcc5-3cd1-4220-8f80-bdbaa95f6991', 'ddd3f787-1c6b-49fc-9906-3a79a0270dc0', '611a632b-fa6c-489f-ba0c-37f541d4c4b4'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:34:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:34:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:34:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:34:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:34:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:34:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.133s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:53 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:34:53 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Deleted volume successfully. Sep 10 15:34:53 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fdbaa662-0815-435b-8de5-852266b2f23f tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-515db04d-0c15-49f7-8a2c-874e5de061a5-delete_volume" released by "delete_volume" :: held 9.300s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:34:54 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:34:54 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:34:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Flow 'volume_create_manager' (0baa4500-f523-4a37-b399-4457ab9de4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:34:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1722c635-bc45-4c88-b723-1db2f02bda0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1722c635-bc45-4c88-b723-1db2f02bda0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-655206854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5bd8fff-6632-411b-9171-17a29640bfc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb954e91e8874b5ba34ca0c4e732facf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:34:55Z,use_quota=True,user_id='0a2705a242834df9b271f5cc3c57060f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0537f84c-f5aa-4c33-bc25-e2fb061ede37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0537f84c-f5aa-4c33-bc25-e2fb061ede37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f872ca85-bfc1-407e-b3d9-af0edf14f400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f872ca85-bfc1-407e-b3d9-af0edf14f400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5bd8fff-6632-411b-9171-17a29640bfc1', 'volume_name': 'volume-b5bd8fff-6632-411b-9171-17a29640bfc1', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08fa3473-9388-49f6-ab8f-45fdba8ff6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08fa3473-9388-49f6-ab8f-45fdba8ff6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82951c07-25c2-477d-bc9b-9a34c367e69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:55 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Volume b5bd8fff-6632-411b-9171-17a29640bfc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5bd8fff-6632-411b-9171-17a29640bfc1', 'volume_size': 1} Sep 10 15:34:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:34:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:34:55 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-655206854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5bd8fff-6632-411b-9171-17a29640bfc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb954e91e8874b5ba34ca0c4e732facf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:34:55Z,use_quota=True,user_id='0a2705a242834df9b271f5cc3c57060f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:34:55 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Creating volume b5bd8fff-6632-411b-9171-17a29640bfc1 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:34:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:34:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:34:55 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:34:55 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:34:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:34:55 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:34:55 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:34:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:55 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=60, name=volume-b5bd8fff-6632-411b-9171-17a29640bfc1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:34:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1 1073741824" returned: 0 in 0.515s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1" returned: 0 in 0.216s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:55 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] <== create_volume: return (866ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:34:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:34:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82951c07-25c2-477d-bc9b-9a34c367e69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5bd8fff-6632-411b-9171-17a29640bfc1', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a03bcb1f-25c1-4efa-9de8-e7872c8fe36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:34:56 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Volume volume-b5bd8fff-6632-411b-9171-17a29640bfc1 (b5bd8fff-6632-411b-9171-17a29640bfc1): created successfully Sep 10 15:34:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a03bcb1f-25c1-4efa-9de8-e7872c8fe36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:34:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Flow 'volume_create_manager' (0baa4500-f523-4a37-b399-4457ab9de4d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:34:56 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-0240336c-2f0f-43ae-b20a-b839b2d4d9b3 tempest-VolumesDeleteCascade-875122981 None] Created volume successfully. Sep 10 15:34:58 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-4c5a1623-6e0c-47a2-8b04-66123af0611a tempest-VolumesDeleteCascade-875122981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:34:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-4c5a1623-6e0c-47a2-8b04-66123af0611a tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:34:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-4c5a1623-6e0c-47a2-8b04-66123af0611a tempest-VolumesDeleteCascade-875122981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:34:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-4c5a1623-6e0c-47a2-8b04-66123af0611a tempest-VolumesDeleteCascade-875122981 None] Creating offline snapshot acf63cdf-39b5-41cd-805c-38f3c507480c of volume b5bd8fff-6632-411b-9171-17a29640bfc1 {{(pid=82800) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 15:34:58 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d822b95-6a32-4b04-9cd2-768e1a0d5b89]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:34:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4c5a1623-6e0c-47a2-8b04-66123af0611a tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4c5a1623-6e0c-47a2-8b04-66123af0611a tempest-VolumesDeleteCascade-875122981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1" returned: 0 in 0.572s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4c5a1623-6e0c-47a2-8b04-66123af0611a tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1.acf63cdf-39b5-41cd-805c-38f3c507480c 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:59 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=61, name=volume-b5bd8fff-6632-411b-9171-17a29640bfc1.acf63cdf-39b5-41cd-805c-38f3c507480c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:34:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4c5a1623-6e0c-47a2-8b04-66123af0611a tempest-VolumesDeleteCascade-875122981 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1.acf63cdf-39b5-41cd-805c-38f3c507480c 1G" returned: 0 in 0.322s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4c5a1623-6e0c-47a2-8b04-66123af0611a tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b5bd8fff-6632-411b-9171-17a29640bfc1 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1.acf63cdf-39b5-41cd-805c-38f3c507480c {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:34:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4c5a1623-6e0c-47a2-8b04-66123af0611a tempest-VolumesDeleteCascade-875122981 None] CMD "qemu-img rebase -u -b volume-b5bd8fff-6632-411b-9171-17a29640bfc1 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1.acf63cdf-39b5-41cd-805c-38f3c507480c" returned: 0 in 0.233s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:34:59 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-4c5a1623-6e0c-47a2-8b04-66123af0611a tempest-VolumesDeleteCascade-875122981 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1.acf63cdf-39b5-41cd-805c-38f3c507480c is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:35:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4c5a1623-6e0c-47a2-8b04-66123af0611a tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1.acf63cdf-39b5-41cd-805c-38f3c507480c {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4c5a1623-6e0c-47a2-8b04-66123af0611a tempest-VolumesDeleteCascade-875122981 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1.acf63cdf-39b5-41cd-805c-38f3c507480c" returned: 0 in 0.100s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:00 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-4c5a1623-6e0c-47a2-8b04-66123af0611a tempest-VolumesDeleteCascade-875122981 None] Setting permissions: /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1 -> 1000:1000 {{(pid=82800) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 15:35:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4c5a1623-6e0c-47a2-8b04-66123af0611a tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1.acf63cdf-39b5-41cd-805c-38f3c507480c {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4c5a1623-6e0c-47a2-8b04-66123af0611a tempest-VolumesDeleteCascade-875122981 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1.acf63cdf-39b5-41cd-805c-38f3c507480c" returned: 0 in 0.106s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4c5a1623-6e0c-47a2-8b04-66123af0611a tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4c5a1623-6e0c-47a2-8b04-66123af0611a tempest-VolumesDeleteCascade-875122981 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1.info" returned: 0 in 0.098s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:00 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-4c5a1623-6e0c-47a2-8b04-66123af0611a tempest-VolumesDeleteCascade-875122981 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1.info is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:35:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4c5a1623-6e0c-47a2-8b04-66123af0611a tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4c5a1623-6e0c-47a2-8b04-66123af0611a tempest-VolumesDeleteCascade-875122981 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1.info" returned: 0 in 0.204s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-4c5a1623-6e0c-47a2-8b04-66123af0611a tempest-VolumesDeleteCascade-875122981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.162s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:35:01 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-4c5a1623-6e0c-47a2-8b04-66123af0611a tempest-VolumesDeleteCascade-875122981 None] Create snapshot completed successfully Sep 10 15:35:04 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Flow 'volume_create_manager' (5f777b0d-63af-45a1-98ce-c8c2ce6d5bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd71778f-79b4-43e6-8724-06134e2e5abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd71778f-79b4-43e6-8724-06134e2e5abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1857830889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e48025d-b74e-4e80-a630-4d96fc6eac46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb954e91e8874b5ba34ca0c4e732facf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=acf63cdf-39b5-41cd-805c-38f3c507480c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:35:04Z,use_quota=True,user_id='0a2705a242834df9b271f5cc3c57060f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f14af07-877b-4050-a84c-2a39c08d7e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f14af07-877b-4050-a84c-2a39c08d7e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f214bd0b-c23d-4f93-8789-a82fe32567b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f214bd0b-c23d-4f93-8789-a82fe32567b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1e48025d-b74e-4e80-a630-4d96fc6eac46', 'volume_name': 'volume-1e48025d-b74e-4e80-a630-4d96fc6eac46', 'volume_size': 1, 'snapshot_id': 'acf63cdf-39b5-41cd-805c-38f3c507480c'}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32bb4fc4-3e8a-4d5d-981d-215f45ac0d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32bb4fc4-3e8a-4d5d-981d-215f45ac0d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ebdc7f-3293-4504-9223-ef669143adfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:04 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Volume 1e48025d-b74e-4e80-a630-4d96fc6eac46: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1e48025d-b74e-4e80-a630-4d96fc6eac46', 'volume_size': 1, 'snapshot_id': 'acf63cdf-39b5-41cd-805c-38f3c507480c'} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "cinder-quobyte-acf63cdf-39b5-41cd-805c-38f3c507480c-1e48025d-b74e-4e80-a630-4d96fc6eac46" by "_create_volume_from_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-quobyte-acf63cdf-39b5-41cd-805c-38f3c507480c-1e48025d-b74e-4e80-a630-4d96fc6eac46" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Creating volume 1e48025d-b74e-4e80-a630-4d96fc6eac46 from snapshot acf63cdf-39b5-41cd-805c-38f3c507480c {{(pid=82800) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "cinder-quobyte-1e48025d-b74e-4e80-a630-4d96fc6eac46" by "_copy_volume_from_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-quobyte-1e48025d-b74e-4e80-a630-4d96fc6eac46" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] snapshot: acf63cdf-39b5-41cd-805c-38f3c507480c, volume: 1e48025d-b74e-4e80-a630-4d96fc6eac46, {{(pid=82800) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.030s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1acbab-c5ba-473d-89f1-bb5f57f71d11]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:35:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1.acf63cdf-39b5-41cd-805c-38f3c507480c {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1.acf63cdf-39b5-41cd-805c-38f3c507480c" returned: 0 in 0.829s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:05 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5bd8fff-6632-411b-9171-17a29640bfc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:35:05 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1 {{(pid=82800) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 10 15:35:05 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Creating direct copy from snapshot {{(pid=82800) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 10 15:35:05 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[534958ad-4645-446c-945d-37d721f4dd0a]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:35:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:06 devstack quobyte-client[82814]: System call of process 92422 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:35:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1" returned: 0 in 1.386s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:07 devstack cinder-volume[82800]: DEBUG cinder.utils [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1e48025d-b74e-4e80-a630-4d96fc6eac46 not found in is_blk_device check {{(pid=82800) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 10 15:35:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1e48025d-b74e-4e80-a630-4d96fc6eac46 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:07 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=63, name=volume-1e48025d-b74e-4e80-a630-4d96fc6eac46, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:35:14 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=57,cinder:DELETE=7,cinder:SELECT=49,cinder:INSERT=10 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:35:14 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=41,cinder:SELECT=35,cinder:INSERT=10,cinder:DELETE=4 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:35:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1e48025d-b74e-4e80-a630-4d96fc6eac46" returned: 0 in 9.708s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:16 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f47743-9e35-4b4e-8ce8-7c08eaf7d683]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:35:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1" returned: 0 in 0.817s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:17 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Image conversion details: src /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1, size 1024.00 MB, duration 9.73 sec, destination /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1e48025d-b74e-4e80-a630-4d96fc6eac46 {{(pid=82800) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 15:35:17 devstack cinder-volume[82800]: INFO cinder.image.image_utils [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Converted 1024.00 MB image at 105.24 MB/s Sep 10 15:35:17 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1e48025d-b74e-4e80-a630-4d96fc6eac46 is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:35:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1e48025d-b74e-4e80-a630-4d96fc6eac46 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1e48025d-b74e-4e80-a630-4d96fc6eac46" returned: 0 in 0.156s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:18 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-quobyte-1e48025d-b74e-4e80-a630-4d96fc6eac46" released by "_copy_volume_from_snapshot" :: held 13.766s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:35:18 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-quobyte-acf63cdf-39b5-41cd-805c-38f3c507480c-1e48025d-b74e-4e80-a630-4d96fc6eac46" released by "_create_volume_from_snapshot" :: held 13.817s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:35:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.865s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:35:18 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29ebdc7f-3293-4504-9223-ef669143adfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e48025d-b74e-4e80-a630-4d96fc6eac46', 'volume_size': 1, 'snapshot_id': 'acf63cdf-39b5-41cd-805c-38f3c507480c'}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:18 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (908b164b-0752-4366-b0d3-016b5521a372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:18 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Volume volume-1e48025d-b74e-4e80-a630-4d96fc6eac46 (1e48025d-b74e-4e80-a630-4d96fc6eac46): created successfully Sep 10 15:35:18 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (908b164b-0752-4366-b0d3-016b5521a372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:18 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Flow 'volume_create_manager' (5f777b0d-63af-45a1-98ce-c8c2ce6d5bb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:35:18 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-6f787cf4-03ef-482d-a559-75e8c1226f9b tempest-VolumesDeleteCascade-875122981 None] Created volume successfully. Sep 10 15:35:19 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "cinder-b5bd8fff-6632-411b-9171-17a29640bfc1-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:35:19 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-b5bd8fff-6632-411b-9171-17a29640bfc1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:35:19 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:35:19 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Performing cascade delete. {{(pid=82800) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 10 15:35:19 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "cinder-acf63cdf-39b5-41cd-805c-38f3c507480c-delete_snapshot" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:35:20 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-acf63cdf-39b5-41cd-805c-38f3c507480c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.081s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:35:20 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:35:20 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "cinder-quobyte-b5bd8fff-6632-411b-9171-17a29640bfc1" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:35:20 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-quobyte-b5bd8fff-6632-411b-9171-17a29640bfc1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:35:20 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "cinder-quobyte-acf63cdf-39b5-41cd-805c-38f3c507480c" by "_delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:35:20 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-quobyte-acf63cdf-39b5-41cd-805c-38f3c507480c" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:35:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Deleting offline snapshot acf63cdf-39b5-41cd-805c-38f3c507480c of volume b5bd8fff-6632-411b-9171-17a29640bfc1 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 15:35:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] snapshot_file for this snap is: volume-b5bd8fff-6632-411b-9171-17a29640bfc1.acf63cdf-39b5-41cd-805c-38f3c507480c {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 15:35:20 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c796bbd-f37f-4f2d-85e1-696bffecfb3f]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:35:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1.acf63cdf-39b5-41cd-805c-38f3c507480c {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:21 devstack quobyte-client[82814]: System call of process 92497 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:35:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1.acf63cdf-39b5-41cd-805c-38f3c507480c" returned: 0 in 1.350s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5bd8fff-6632-411b-9171-17a29640bfc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:35:21 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:35:21 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:35:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Flow 'volume_create_manager' (6820f275-e2af-4920-85dc-c820f2ae91b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:35:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee27bf7-daa4-433f-9bfd-e3e2e9c57c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:21 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[859f527b-4748-4713-b278-839ab4f0c996]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:35:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee27bf7-daa4-433f-9bfd-e3e2e9c57c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1138844180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3dde7ce-facf-459f-b281-732938721db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5e10af9598401480c6093b1e8094be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:35:21Z,use_quota=True,user_id='ed7093d1733141bd8ba686060634d761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea60d8a-a70c-48bf-98a1-7217a061cf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea60d8a-a70c-48bf-98a1-7217a061cf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d804ab-8d12-45e5-b1d6-cbb4d00496df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d804ab-8d12-45e5-b1d6-cbb4d00496df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3dde7ce-facf-459f-b281-732938721db3', 'volume_name': 'volume-b3dde7ce-facf-459f-b281-732938721db3', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91a22d4a-91d7-4039-98ab-48d544968200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91a22d4a-91d7-4039-98ab-48d544968200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282285aa-3c94-4069-b22d-8d5b1efc5745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:21 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Volume b3dde7ce-facf-459f-b281-732938721db3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3dde7ce-facf-459f-b281-732938721db3', 'volume_size': 1} Sep 10 15:35:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:35:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:35:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1138844180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3dde7ce-facf-459f-b281-732938721db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5e10af9598401480c6093b1e8094be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:35:21Z,use_quota=True,user_id='ed7093d1733141bd8ba686060634d761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:35:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Creating volume b3dde7ce-facf-459f-b281-732938721db3 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:35:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:35:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:35:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:35:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:35:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:35:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:35:21 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:35:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b3dde7ce-facf-459f-b281-732938721db3 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:22 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=64, name=volume-b3dde7ce-facf-459f-b281-732938721db3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:35:22 devstack quobyte-client[82814]: System call of process 92511 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:35:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b3dde7ce-facf-459f-b281-732938721db3 1073741824" returned: 0 in 0.817s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b3dde7ce-facf-459f-b281-732938721db3 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1" returned: 0 in 0.931s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1.acf63cdf-39b5-41cd-805c-38f3c507480c {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b3dde7ce-facf-459f-b281-732938721db3" returned: 0 in 0.827s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:23 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] <== create_volume: return (1791ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:35:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:35:23 devstack quobyte-client[82814]: System call of process 92535 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:35:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282285aa-3c94-4069-b22d-8d5b1efc5745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3dde7ce-facf-459f-b281-732938721db3', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94615dc1-218e-47aa-98d8-6feeefee1d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1.acf63cdf-39b5-41cd-805c-38f3c507480c" returned: 0 in 0.928s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1.acf63cdf-39b5-41cd-805c-38f3c507480c {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:24 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Volume volume-b3dde7ce-facf-459f-b281-732938721db3 (b3dde7ce-facf-459f-b281-732938721db3): created successfully Sep 10 15:35:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94615dc1-218e-47aa-98d8-6feeefee1d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Flow 'volume_create_manager' (6820f275-e2af-4920-85dc-c820f2ae91b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:35:25 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-b8d2fa6f-2453-41a0-b464-610c2df0a990 tempest-VolumesListAdminTestJSON-844315908 None] Created volume successfully. Sep 10 15:35:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1.acf63cdf-39b5-41cd-805c-38f3c507480c" returned: 0 in 1.015s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:25 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-quobyte-acf63cdf-39b5-41cd-805c-38f3c507480c" released by "_delete_snapshot" :: held 5.253s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:35:25 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-quobyte-b5bd8fff-6632-411b-9171-17a29640bfc1" released by "delete_snapshot" :: held 5.419s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:35:25 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Created reservations ['04ef9d7f-cc8d-4631-a8fd-d71b4b7407b2', '7cf369b9-5a43-4b01-84cb-f5ba5526d485', '7f177ad4-cc1a-447c-a433-9978167650af', '2abbd476-8f53-4ae6-8da4-491112f07fcc'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:35:25 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Delete snapshot completed successfully. Sep 10 15:35:26 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-acf63cdf-39b5-41cd-805c-38f3c507480c-delete_snapshot" released by "delete_snapshot" :: held 5.949s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:35:26 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Snapshots deleted, issuing volume delete {{(pid=82800) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 10 15:35:26 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "cinder-quobyte-b5bd8fff-6632-411b-9171-17a29640bfc1" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:35:26 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-quobyte-b5bd8fff-6632-411b-9171-17a29640bfc1" acquired by "delete_volume" :: waited 0.033s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:35:26 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e2d9a3-45ee-4060-9914-8bcfce5cd098]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:35:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1" returned: 0 in 1.032s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:27 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:35:27 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:35:27 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Flow 'volume_create_manager' (00522f91-7a26-4061-8e25-ea1cb927ace5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:35:27 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3667a54e-c809-4062-b30b-de783e07236a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b5bd8fff-6632-411b-9171-17a29640bfc1" returned: 0 in 0.493s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:27 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3667a54e-c809-4062-b30b-de783e07236a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-384877486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=984f4062-74df-44f4-90eb-716f660424c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5e10af9598401480c6093b1e8094be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:35:27Z,use_quota=True,user_id='ed7093d1733141bd8ba686060634d761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:27 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b2bf92d-91b0-440b-a55a-07cd654a785b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:27 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b2bf92d-91b0-440b-a55a-07cd654a785b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:27 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05eaee4e-42d2-4bd2-9f2a-f9447158d59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:27 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05eaee4e-42d2-4bd2-9f2a-f9447158d59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '984f4062-74df-44f4-90eb-716f660424c3', 'volume_name': 'volume-984f4062-74df-44f4-90eb-716f660424c3', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:27 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a790da-6318-4005-8e51-c883d0518183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:27 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a790da-6318-4005-8e51-c883d0518183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:27 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc6eb3f-f68a-44ad-88fe-f4ea4464f9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:27 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Volume 984f4062-74df-44f4-90eb-716f660424c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-984f4062-74df-44f4-90eb-716f660424c3', 'volume_size': 1} Sep 10 15:35:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:35:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:35:27 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-384877486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=984f4062-74df-44f4-90eb-716f660424c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5e10af9598401480c6093b1e8094be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:35:27Z,use_quota=True,user_id='ed7093d1733141bd8ba686060634d761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:35:27 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Creating volume 984f4062-74df-44f4-90eb-716f660424c3 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:35:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:35:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:35:27 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:35:27 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:35:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:35:27 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:35:27 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:35:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-984f4062-74df-44f4-90eb-716f660424c3 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:27 devstack quobyte-client[82814]: System call of process 92580 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:35:27 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=65, name=volume-984f4062-74df-44f4-90eb-716f660424c3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:35:28 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-quobyte-b5bd8fff-6632-411b-9171-17a29640bfc1" released by "delete_volume" :: held 2.000s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:35:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-984f4062-74df-44f4-90eb-716f660424c3 1073741824" returned: 0 in 0.617s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-984f4062-74df-44f4-90eb-716f660424c3 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-984f4062-74df-44f4-90eb-716f660424c3" returned: 0 in 0.403s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] <== create_volume: return (1082ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:35:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:35:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc6eb3f-f68a-44ad-88fe-f4ea4464f9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-984f4062-74df-44f4-90eb-716f660424c3', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cd9f2f7-e33c-4e6d-b62a-9784883da17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:29 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Volume volume-984f4062-74df-44f4-90eb-716f660424c3 (984f4062-74df-44f4-90eb-716f660424c3): created successfully Sep 10 15:35:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cd9f2f7-e33c-4e6d-b62a-9784883da17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Flow 'volume_create_manager' (00522f91-7a26-4061-8e25-ea1cb927ace5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:35:29 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-0d07f768-cdef-4228-930b-7b90f9e16caa tempest-VolumesListAdminTestJSON-844315908 None] Created volume successfully. Sep 10 15:35:29 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Created reservations ['019b7d35-26d8-4b44-bdaf-5d2ee4a40144', '97028f69-099e-4858-95f7-ae2356d58efd', '841c73e2-e0bb-42e2-9f96-b56911945975', '2ce01915-1520-4c19-88fa-0a4d8115ca06'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:35:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:35:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:35:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:35:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:35:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:35:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:35:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.214s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:35:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:35:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:35:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:35:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:35:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:35:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.216s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:35:30 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Deleted volume successfully. Sep 10 15:35:30 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-228a0a6b-00f4-4902-a731-7aed1d7ab7a0 tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-b5bd8fff-6632-411b-9171-17a29640bfc1-delete_volume" released by "delete_volume" :: held 10.686s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:35:30 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-44444a3c-7ad0-4a82-9ea3-e4cfdf3fa8cf tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "cinder-1e48025d-b74e-4e80-a630-4d96fc6eac46-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:35:30 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-44444a3c-7ad0-4a82-9ea3-e4cfdf3fa8cf tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-1e48025d-b74e-4e80-a630-4d96fc6eac46-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:35:30 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-44444a3c-7ad0-4a82-9ea3-e4cfdf3fa8cf tempest-VolumesDeleteCascade-875122981 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:35:30 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-44444a3c-7ad0-4a82-9ea3-e4cfdf3fa8cf tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "cinder-quobyte-1e48025d-b74e-4e80-a630-4d96fc6eac46" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:35:30 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-44444a3c-7ad0-4a82-9ea3-e4cfdf3fa8cf tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-quobyte-1e48025d-b74e-4e80-a630-4d96fc6eac46" acquired by "delete_volume" :: waited 0.019s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:35:31 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[529a4c42-e264-44ed-b84e-bc3a2b0a617d]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:35:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-44444a3c-7ad0-4a82-9ea3-e4cfdf3fa8cf tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1e48025d-b74e-4e80-a630-4d96fc6eac46 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:31 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:35:31 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:35:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Flow 'volume_create_manager' (b4210d6b-7de5-41f5-b721-3f9f04fcacbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:35:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac1b7b04-ddcd-4a34-ac9b-651730e23f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac1b7b04-ddcd-4a34-ac9b-651730e23f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1365164321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1dfa8a6-b806-4ac0-b45f-b1cd5d3355c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5e10af9598401480c6093b1e8094be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:35:31Z,use_quota=True,user_id='ed7093d1733141bd8ba686060634d761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4e84bf-e5cd-4648-a594-3724fd1cf4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4e84bf-e5cd-4648-a594-3724fd1cf4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4853b398-bf40-49e5-9677-f2215599421c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4853b398-bf40-49e5-9677-f2215599421c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1dfa8a6-b806-4ac0-b45f-b1cd5d3355c0', 'volume_name': 'volume-b1dfa8a6-b806-4ac0-b45f-b1cd5d3355c0', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94569bcd-5866-4bcf-8e22-5e4bb311ba83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94569bcd-5866-4bcf-8e22-5e4bb311ba83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f1899ab-d60f-40d3-8b88-acc9450893b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:32 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Volume b1dfa8a6-b806-4ac0-b45f-b1cd5d3355c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1dfa8a6-b806-4ac0-b45f-b1cd5d3355c0', 'volume_size': 1} Sep 10 15:35:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:35:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:35:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1365164321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1dfa8a6-b806-4ac0-b45f-b1cd5d3355c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b5e10af9598401480c6093b1e8094be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:35:31Z,use_quota=True,user_id='ed7093d1733141bd8ba686060634d761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:35:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Creating volume b1dfa8a6-b806-4ac0-b45f-b1cd5d3355c0 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:35:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:35:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:35:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:35:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:35:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:35:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:35:32 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:35:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b1dfa8a6-b806-4ac0-b45f-b1cd5d3355c0 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:32 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=66, name=volume-b1dfa8a6-b806-4ac0-b45f-b1cd5d3355c0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:35:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-44444a3c-7ad0-4a82-9ea3-e4cfdf3fa8cf tempest-VolumesDeleteCascade-875122981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1e48025d-b74e-4e80-a630-4d96fc6eac46" returned: 0 in 1.285s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-44444a3c-7ad0-4a82-9ea3-e4cfdf3fa8cf tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1e48025d-b74e-4e80-a630-4d96fc6eac46 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b1dfa8a6-b806-4ac0-b45f-b1cd5d3355c0 1073741824" returned: 0 in 0.572s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b1dfa8a6-b806-4ac0-b45f-b1cd5d3355c0 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-44444a3c-7ad0-4a82-9ea3-e4cfdf3fa8cf tempest-VolumesDeleteCascade-875122981 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1e48025d-b74e-4e80-a630-4d96fc6eac46" returned: 0 in 0.373s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:33 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-44444a3c-7ad0-4a82-9ea3-e4cfdf3fa8cf tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-quobyte-1e48025d-b74e-4e80-a630-4d96fc6eac46" released by "delete_volume" :: held 2.026s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:35:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b1dfa8a6-b806-4ac0-b45f-b1cd5d3355c0" returned: 0 in 0.521s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:33 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] <== create_volume: return (1162ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:35:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:35:33 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f1899ab-d60f-40d3-8b88-acc9450893b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1dfa8a6-b806-4ac0-b45f-b1cd5d3355c0', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:33 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7848aed-2f63-499a-9ea6-7620fe289976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:33 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-44444a3c-7ad0-4a82-9ea3-e4cfdf3fa8cf tempest-VolumesDeleteCascade-875122981 None] Created reservations ['c66be2fc-ffbc-4ae0-8d3c-543c64792486', 'acc0062d-50b2-4abb-84dc-def762df54f9', 'be648d94-617b-4376-bb5d-f5cb4b6b4382', '510dcbfe-ccd3-4a5e-9a1b-de496d79c0e1'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:35:33 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Volume volume-b1dfa8a6-b806-4ac0-b45f-b1cd5d3355c0 (b1dfa8a6-b806-4ac0-b45f-b1cd5d3355c0): created successfully Sep 10 15:35:33 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7848aed-2f63-499a-9ea6-7620fe289976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:33 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Flow 'volume_create_manager' (b4210d6b-7de5-41f5-b721-3f9f04fcacbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:35:33 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-83daa4f8-f088-4ace-9589-ea7e2da484a4 tempest-VolumesListAdminTestJSON-844315908 None] Created volume successfully. Sep 10 15:35:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-44444a3c-7ad0-4a82-9ea3-e4cfdf3fa8cf tempest-VolumesDeleteCascade-875122981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:35:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-44444a3c-7ad0-4a82-9ea3-e4cfdf3fa8cf tempest-VolumesDeleteCascade-875122981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:35:33 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-44444a3c-7ad0-4a82-9ea3-e4cfdf3fa8cf tempest-VolumesDeleteCascade-875122981 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:35:33 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-44444a3c-7ad0-4a82-9ea3-e4cfdf3fa8cf tempest-VolumesDeleteCascade-875122981 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:35:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-44444a3c-7ad0-4a82-9ea3-e4cfdf3fa8cf tempest-VolumesDeleteCascade-875122981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:35:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-44444a3c-7ad0-4a82-9ea3-e4cfdf3fa8cf tempest-VolumesDeleteCascade-875122981 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-44444a3c-7ad0-4a82-9ea3-e4cfdf3fa8cf tempest-VolumesDeleteCascade-875122981 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.157s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:33 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-44444a3c-7ad0-4a82-9ea3-e4cfdf3fa8cf tempest-VolumesDeleteCascade-875122981 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:35:33 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-44444a3c-7ad0-4a82-9ea3-e4cfdf3fa8cf tempest-VolumesDeleteCascade-875122981 None] Deleted volume successfully. Sep 10 15:35:34 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-44444a3c-7ad0-4a82-9ea3-e4cfdf3fa8cf tempest-VolumesDeleteCascade-875122981 None] Lock "cinder-1e48025d-b74e-4e80-a630-4d96fc6eac46-delete_volume" released by "delete_volume" :: held 3.627s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:35:36 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:35:36 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:35:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Flow 'volume_create_manager' (02ea0969-d9ff-4e83-bc45-941594a60c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:35:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ca5dc0-33d3-4488-8456-fc79578b4ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ca5dc0-33d3-4488-8456-fc79578b4ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20eec068-1bd2-4ca8-afe0-db707436f964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6586adef1e8e4892876d2e2a8e848e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:35:35Z,use_quota=True,user_id='9a524bac2e974318a082e82fa12b5b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d54ae67-311a-48c5-9b3a-d3bc0880f425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d54ae67-311a-48c5-9b3a-d3bc0880f425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (127f16cf-8096-48c3-894a-f258f911dd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (127f16cf-8096-48c3-894a-f258f911dd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20eec068-1bd2-4ca8-afe0-db707436f964', 'volume_name': 'volume-20eec068-1bd2-4ca8-afe0-db707436f964', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (053c3260-e4c5-421e-ba54-b9ef763b8b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (053c3260-e4c5-421e-ba54-b9ef763b8b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2218c61-4d53-4345-8184-6e26679cacf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:36 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Volume 20eec068-1bd2-4ca8-afe0-db707436f964: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20eec068-1bd2-4ca8-afe0-db707436f964', 'volume_size': 1} Sep 10 15:35:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:35:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:35:36 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20eec068-1bd2-4ca8-afe0-db707436f964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6586adef1e8e4892876d2e2a8e848e63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:35:35Z,use_quota=True,user_id='9a524bac2e974318a082e82fa12b5b86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:35:36 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Creating volume 20eec068-1bd2-4ca8-afe0-db707436f964 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:35:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:35:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:35:36 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:35:36 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:35:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:35:36 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:35:36 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:35:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-20eec068-1bd2-4ca8-afe0-db707436f964 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:36 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=67, name=volume-20eec068-1bd2-4ca8-afe0-db707436f964, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:35:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-20eec068-1bd2-4ca8-afe0-db707436f964 1073741824" returned: 0 in 0.636s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-20eec068-1bd2-4ca8-afe0-db707436f964 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-20eec068-1bd2-4ca8-afe0-db707436f964" returned: 0 in 0.309s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:37 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] <== create_volume: return (1031ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:35:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:35:38 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2218c61-4d53-4345-8184-6e26679cacf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20eec068-1bd2-4ca8-afe0-db707436f964', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:38 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (876c52ca-e4bd-4a8b-9e5d-3591bf849f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:38 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Volume volume-20eec068-1bd2-4ca8-afe0-db707436f964 (20eec068-1bd2-4ca8-afe0-db707436f964): created successfully Sep 10 15:35:38 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (876c52ca-e4bd-4a8b-9e5d-3591bf849f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:38 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Flow 'volume_create_manager' (02ea0969-d9ff-4e83-bc45-941594a60c0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:35:38 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-89a5bf4f-0589-4b00-bc66-a37f8d6369d7 tempest-VolumesListAdminTestJSON-958583163 None] Created volume successfully. Sep 10 15:35:39 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9e757970-778d-45d6-854c-68c6c3901bde tempest-VolumesListAdminTestJSON-958583163 None] Acquiring lock "cinder-20eec068-1bd2-4ca8-afe0-db707436f964-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:35:39 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9e757970-778d-45d6-854c-68c6c3901bde tempest-VolumesListAdminTestJSON-958583163 None] Lock "cinder-20eec068-1bd2-4ca8-afe0-db707436f964-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:35:39 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-9e757970-778d-45d6-854c-68c6c3901bde tempest-VolumesListAdminTestJSON-958583163 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:35:39 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9e757970-778d-45d6-854c-68c6c3901bde tempest-VolumesListAdminTestJSON-958583163 None] Acquiring lock "cinder-quobyte-20eec068-1bd2-4ca8-afe0-db707436f964" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:35:39 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b764d72f-a3e4-493e-934a-17e333e9c2ba tempest-VolumesListAdminTestJSON-844315908 None] Acquiring lock "cinder-b1dfa8a6-b806-4ac0-b45f-b1cd5d3355c0-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:35:39 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9e757970-778d-45d6-854c-68c6c3901bde tempest-VolumesListAdminTestJSON-958583163 None] Lock "cinder-quobyte-20eec068-1bd2-4ca8-afe0-db707436f964" acquired by "delete_volume" :: waited 0.034s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:35:39 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b764d72f-a3e4-493e-934a-17e333e9c2ba tempest-VolumesListAdminTestJSON-844315908 None] Lock "cinder-b1dfa8a6-b806-4ac0-b45f-b1cd5d3355c0-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:35:39 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6007db6-c43d-4a07-80d9-ca9866f19cb5]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:35:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9e757970-778d-45d6-854c-68c6c3901bde tempest-VolumesListAdminTestJSON-958583163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-20eec068-1bd2-4ca8-afe0-db707436f964 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:40 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-b764d72f-a3e4-493e-934a-17e333e9c2ba tempest-VolumesListAdminTestJSON-844315908 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:35:40 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b764d72f-a3e4-493e-934a-17e333e9c2ba tempest-VolumesListAdminTestJSON-844315908 None] Acquiring lock "cinder-quobyte-b1dfa8a6-b806-4ac0-b45f-b1cd5d3355c0" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:35:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b764d72f-a3e4-493e-934a-17e333e9c2ba tempest-VolumesListAdminTestJSON-844315908 None] Lock "cinder-quobyte-b1dfa8a6-b806-4ac0-b45f-b1cd5d3355c0" acquired by "delete_volume" :: waited 0.085s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:35:41 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f3adb3-9146-4745-b2f2-1438f80662d8]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:35:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b764d72f-a3e4-493e-934a-17e333e9c2ba tempest-VolumesListAdminTestJSON-844315908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b1dfa8a6-b806-4ac0-b45f-b1cd5d3355c0 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9e757970-778d-45d6-854c-68c6c3901bde tempest-VolumesListAdminTestJSON-958583163 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-20eec068-1bd2-4ca8-afe0-db707436f964" returned: 0 in 1.558s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9e757970-778d-45d6-854c-68c6c3901bde tempest-VolumesListAdminTestJSON-958583163 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-20eec068-1bd2-4ca8-afe0-db707436f964 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:42 devstack quobyte-client[82814]: System call of process 92607 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:35:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9e757970-778d-45d6-854c-68c6c3901bde tempest-VolumesListAdminTestJSON-958583163 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-20eec068-1bd2-4ca8-afe0-db707436f964" returned: 0 in 0.601s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b764d72f-a3e4-493e-934a-17e333e9c2ba tempest-VolumesListAdminTestJSON-844315908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b1dfa8a6-b806-4ac0-b45f-b1cd5d3355c0" returned: 0 in 1.085s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b764d72f-a3e4-493e-934a-17e333e9c2ba tempest-VolumesListAdminTestJSON-844315908 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b1dfa8a6-b806-4ac0-b45f-b1cd5d3355c0 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:42 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:35:42 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:35:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Flow 'volume_create_manager' (2d9ffee7-b784-4608-99c9-2f87f99ab214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:35:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991efea6-9f21-430b-b7c0-ce4df32e89d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:42 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9e757970-778d-45d6-854c-68c6c3901bde tempest-VolumesListAdminTestJSON-958583163 None] Lock "cinder-quobyte-20eec068-1bd2-4ca8-afe0-db707436f964" released by "delete_volume" :: held 3.052s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:35:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b764d72f-a3e4-493e-934a-17e333e9c2ba tempest-VolumesListAdminTestJSON-844315908 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b1dfa8a6-b806-4ac0-b45f-b1cd5d3355c0" returned: 0 in 0.579s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991efea6-9f21-430b-b7c0-ce4df32e89d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-259685394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99059a61-a304-43ad-8af0-eb34ad38bbfa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f5417c765e7a45c384b13fc0f4229024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:35:42Z,use_quota=True,user_id='c5288bcc4f954814827ac5a84461928b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5954980-554c-49a0-bfde-e68f21b59c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5954980-554c-49a0-bfde-e68f21b59c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87af9c3-ed05-4ea3-baf3-2a34ecae8537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e87af9c3-ed05-4ea3-baf3-2a34ecae8537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99059a61-a304-43ad-8af0-eb34ad38bbfa', 'volume_name': 'volume-99059a61-a304-43ad-8af0-eb34ad38bbfa', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f2a548-2265-4632-a4c4-91552bb48ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f2a548-2265-4632-a4c4-91552bb48ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc437e5-cfba-44e0-b6e5-24bfe3432972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:42 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Volume 99059a61-a304-43ad-8af0-eb34ad38bbfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99059a61-a304-43ad-8af0-eb34ad38bbfa', 'volume_size': 1} Sep 10 15:35:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:35:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:35:42 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-259685394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99059a61-a304-43ad-8af0-eb34ad38bbfa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f5417c765e7a45c384b13fc0f4229024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:35:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:35:42Z,use_quota=True,user_id='c5288bcc4f954814827ac5a84461928b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:35:42 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Creating volume 99059a61-a304-43ad-8af0-eb34ad38bbfa {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:35:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:35:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:35:42 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:35:42 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:35:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:35:42 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:35:42 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:35:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-99059a61-a304-43ad-8af0-eb34ad38bbfa 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:43 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=68, name=volume-99059a61-a304-43ad-8af0-eb34ad38bbfa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:35:43 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b764d72f-a3e4-493e-934a-17e333e9c2ba tempest-VolumesListAdminTestJSON-844315908 None] Lock "cinder-quobyte-b1dfa8a6-b806-4ac0-b45f-b1cd5d3355c0" released by "delete_volume" :: held 2.249s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:35:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-99059a61-a304-43ad-8af0-eb34ad38bbfa 1073741824" returned: 0 in 0.544s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-99059a61-a304-43ad-8af0-eb34ad38bbfa {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:43 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-9e757970-778d-45d6-854c-68c6c3901bde tempest-VolumesListAdminTestJSON-958583163 None] Created reservations ['5964862f-bea7-4407-a5a4-832aa5f470cf', 'a1533027-1fb4-4dae-b1d9-4abc62d9c32c', 'e656c3f6-281e-48c5-beb8-32a4f799f2e7', 'a4d68c82-c745-4539-8b34-5f6359fd0266'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:35:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-99059a61-a304-43ad-8af0-eb34ad38bbfa" returned: 0 in 0.538s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] <== create_volume: return (1107ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:35:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:35:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-9e757970-778d-45d6-854c-68c6c3901bde tempest-VolumesListAdminTestJSON-958583163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:35:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-9e757970-778d-45d6-854c-68c6c3901bde tempest-VolumesListAdminTestJSON-958583163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:35:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-9e757970-778d-45d6-854c-68c6c3901bde tempest-VolumesListAdminTestJSON-958583163 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:35:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-9e757970-778d-45d6-854c-68c6c3901bde tempest-VolumesListAdminTestJSON-958583163 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:35:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-9e757970-778d-45d6-854c-68c6c3901bde tempest-VolumesListAdminTestJSON-958583163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:35:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9e757970-778d-45d6-854c-68c6c3901bde tempest-VolumesListAdminTestJSON-958583163 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:44 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc437e5-cfba-44e0-b6e5-24bfe3432972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99059a61-a304-43ad-8af0-eb34ad38bbfa', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:44 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bfe8722-1918-477f-845a-63ca51f16e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:44 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-b764d72f-a3e4-493e-934a-17e333e9c2ba tempest-VolumesListAdminTestJSON-844315908 None] Created reservations ['b36008ad-154b-42ee-8289-6193ee1530c4', '50bf8c2a-078a-441a-ad36-775cdd7053bd', '17d5abe9-6780-436f-a945-883688e1121a', '5e10eb24-6651-4bf0-b35e-07edc1ca94b4'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:35:44 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Volume volume-99059a61-a304-43ad-8af0-eb34ad38bbfa (99059a61-a304-43ad-8af0-eb34ad38bbfa): created successfully Sep 10 15:35:44 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bfe8722-1918-477f-845a-63ca51f16e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:44 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Flow 'volume_create_manager' (2d9ffee7-b784-4608-99c9-2f87f99ab214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:35:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9e757970-778d-45d6-854c-68c6c3901bde tempest-VolumesListAdminTestJSON-958583163 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.563s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:44 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-9e757970-778d-45d6-854c-68c6c3901bde tempest-VolumesListAdminTestJSON-958583163 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:35:44 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-9e757970-778d-45d6-854c-68c6c3901bde tempest-VolumesListAdminTestJSON-958583163 None] Deleted volume successfully. Sep 10 15:35:44 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-f7e5070a-8c79-4398-a368-a1c25069970c tempest-VolumesListTestJSON-217870622 None] Created volume successfully. Sep 10 15:35:44 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9e757970-778d-45d6-854c-68c6c3901bde tempest-VolumesListAdminTestJSON-958583163 None] Lock "cinder-20eec068-1bd2-4ca8-afe0-db707436f964-delete_volume" released by "delete_volume" :: held 5.247s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:35:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b764d72f-a3e4-493e-934a-17e333e9c2ba tempest-VolumesListAdminTestJSON-844315908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:35:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b764d72f-a3e4-493e-934a-17e333e9c2ba tempest-VolumesListAdminTestJSON-844315908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:35:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b764d72f-a3e4-493e-934a-17e333e9c2ba tempest-VolumesListAdminTestJSON-844315908 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:35:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b764d72f-a3e4-493e-934a-17e333e9c2ba tempest-VolumesListAdminTestJSON-844315908 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:35:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b764d72f-a3e4-493e-934a-17e333e9c2ba tempest-VolumesListAdminTestJSON-844315908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:35:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b764d72f-a3e4-493e-934a-17e333e9c2ba tempest-VolumesListAdminTestJSON-844315908 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b764d72f-a3e4-493e-934a-17e333e9c2ba tempest-VolumesListAdminTestJSON-844315908 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.160s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:45 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-b764d72f-a3e4-493e-934a-17e333e9c2ba tempest-VolumesListAdminTestJSON-844315908 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:35:45 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-b764d72f-a3e4-493e-934a-17e333e9c2ba tempest-VolumesListAdminTestJSON-844315908 None] Deleted volume successfully. Sep 10 15:35:45 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b764d72f-a3e4-493e-934a-17e333e9c2ba tempest-VolumesListAdminTestJSON-844315908 None] Lock "cinder-b1dfa8a6-b806-4ac0-b45f-b1cd5d3355c0-delete_volume" released by "delete_volume" :: held 5.668s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-3532c4fd-cb3e-4aa8-8a99-a47b66fc90c6 tempest-VolumesListAdminTestJSON-844315908 None] Acquiring lock "cinder-984f4062-74df-44f4-90eb-716f660424c3-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-3532c4fd-cb3e-4aa8-8a99-a47b66fc90c6 tempest-VolumesListAdminTestJSON-844315908 None] Lock "cinder-984f4062-74df-44f4-90eb-716f660424c3-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:35:46 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Flow 'volume_create_manager' (5a703003-a245-4415-b9d9-83f23bd3005a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3915911a-3d98-4b56-847c-f4fff523964f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:46 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-3532c4fd-cb3e-4aa8-8a99-a47b66fc90c6 tempest-VolumesListAdminTestJSON-844315908 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-3532c4fd-cb3e-4aa8-8a99-a47b66fc90c6 tempest-VolumesListAdminTestJSON-844315908 None] Acquiring lock "cinder-quobyte-984f4062-74df-44f4-90eb-716f660424c3" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3915911a-3d98-4b56-847c-f4fff523964f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1347631020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e569662-518c-4747-a21b-ae2b48d0aa60,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f5417c765e7a45c384b13fc0f4229024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:35:46Z,use_quota=True,user_id='c5288bcc4f954814827ac5a84461928b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b43594f-77b9-4cc3-925b-9e90e83e42ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b43594f-77b9-4cc3-925b-9e90e83e42ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd6ad27-c7a4-4335-aa6e-38ac667b3f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbd6ad27-c7a4-4335-aa6e-38ac667b3f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e569662-518c-4747-a21b-ae2b48d0aa60', 'volume_name': 'volume-8e569662-518c-4747-a21b-ae2b48d0aa60', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5036f2-dd2a-4d36-86f3-aa8df3e10e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5036f2-dd2a-4d36-86f3-aa8df3e10e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6764d854-4c81-47c3-be80-8deee9eccf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:46 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Volume 8e569662-518c-4747-a21b-ae2b48d0aa60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e569662-518c-4747-a21b-ae2b48d0aa60', 'volume_size': 1} Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1347631020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e569662-518c-4747-a21b-ae2b48d0aa60,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f5417c765e7a45c384b13fc0f4229024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:35:46Z,use_quota=True,user_id='c5288bcc4f954814827ac5a84461928b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Creating volume 8e569662-518c-4747-a21b-ae2b48d0aa60 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:35:46 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8e569662-518c-4747-a21b-ae2b48d0aa60 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:46 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=69, name=volume-8e569662-518c-4747-a21b-ae2b48d0aa60, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-3532c4fd-cb3e-4aa8-8a99-a47b66fc90c6 tempest-VolumesListAdminTestJSON-844315908 None] Lock "cinder-quobyte-984f4062-74df-44f4-90eb-716f660424c3" acquired by "delete_volume" :: waited 0.312s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[454138d1-38c2-40a9-be0a-09a9b2d18510]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:35:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3532c4fd-cb3e-4aa8-8a99-a47b66fc90c6 tempest-VolumesListAdminTestJSON-844315908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-984f4062-74df-44f4-90eb-716f660424c3 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8e569662-518c-4747-a21b-ae2b48d0aa60 1073741824" returned: 0 in 0.516s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8e569662-518c-4747-a21b-ae2b48d0aa60 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8e569662-518c-4747-a21b-ae2b48d0aa60" returned: 0 in 0.376s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:47 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] <== create_volume: return (1025ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:35:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:35:47 devstack quobyte-client[82814]: System call of process 92621 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:35:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3532c4fd-cb3e-4aa8-8a99-a47b66fc90c6 tempest-VolumesListAdminTestJSON-844315908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-984f4062-74df-44f4-90eb-716f660424c3" returned: 0 in 0.898s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3532c4fd-cb3e-4aa8-8a99-a47b66fc90c6 tempest-VolumesListAdminTestJSON-844315908 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-984f4062-74df-44f4-90eb-716f660424c3 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:48 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6764d854-4c81-47c3-be80-8deee9eccf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e569662-518c-4747-a21b-ae2b48d0aa60', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:48 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd5cde6-34fd-4864-a45b-4a11ad6bb0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3532c4fd-cb3e-4aa8-8a99-a47b66fc90c6 tempest-VolumesListAdminTestJSON-844315908 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-984f4062-74df-44f4-90eb-716f660424c3" returned: 0 in 0.381s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:48 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-3532c4fd-cb3e-4aa8-8a99-a47b66fc90c6 tempest-VolumesListAdminTestJSON-844315908 None] Lock "cinder-quobyte-984f4062-74df-44f4-90eb-716f660424c3" released by "delete_volume" :: held 1.417s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:35:48 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Volume volume-8e569662-518c-4747-a21b-ae2b48d0aa60 (8e569662-518c-4747-a21b-ae2b48d0aa60): created successfully Sep 10 15:35:48 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd5cde6-34fd-4864-a45b-4a11ad6bb0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:48 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Flow 'volume_create_manager' (5a703003-a245-4415-b9d9-83f23bd3005a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:35:48 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-a3461373-685a-4c47-94db-3702fbbe3bee tempest-VolumesListTestJSON-217870622 None] Created volume successfully. Sep 10 15:35:48 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-3532c4fd-cb3e-4aa8-8a99-a47b66fc90c6 tempest-VolumesListAdminTestJSON-844315908 None] Created reservations ['214dedee-eff6-4dc3-9a1d-f0141a2db128', 'aa7ed833-8c70-4f4a-8fde-8f75d4e36dda', '5aaad7d9-42a0-4e03-a9ad-f2c2574bef7f', '8c9f70b1-f5a4-42c4-86ce-ec8292550f94'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:35:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-3532c4fd-cb3e-4aa8-8a99-a47b66fc90c6 tempest-VolumesListAdminTestJSON-844315908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:35:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-3532c4fd-cb3e-4aa8-8a99-a47b66fc90c6 tempest-VolumesListAdminTestJSON-844315908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:35:48 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-3532c4fd-cb3e-4aa8-8a99-a47b66fc90c6 tempest-VolumesListAdminTestJSON-844315908 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:35:48 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-3532c4fd-cb3e-4aa8-8a99-a47b66fc90c6 tempest-VolumesListAdminTestJSON-844315908 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:35:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-3532c4fd-cb3e-4aa8-8a99-a47b66fc90c6 tempest-VolumesListAdminTestJSON-844315908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:35:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3532c4fd-cb3e-4aa8-8a99-a47b66fc90c6 tempest-VolumesListAdminTestJSON-844315908 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3532c4fd-cb3e-4aa8-8a99-a47b66fc90c6 tempest-VolumesListAdminTestJSON-844315908 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.286s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:49 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-3532c4fd-cb3e-4aa8-8a99-a47b66fc90c6 tempest-VolumesListAdminTestJSON-844315908 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:35:49 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-3532c4fd-cb3e-4aa8-8a99-a47b66fc90c6 tempest-VolumesListAdminTestJSON-844315908 None] Deleted volume successfully. Sep 10 15:35:49 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-3532c4fd-cb3e-4aa8-8a99-a47b66fc90c6 tempest-VolumesListAdminTestJSON-844315908 None] Lock "cinder-984f4062-74df-44f4-90eb-716f660424c3-delete_volume" released by "delete_volume" :: held 3.433s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:35:49 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:35:49 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:35:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Flow 'volume_create_manager' (5313397d-765c-4a14-9b3b-ed095fa67c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:35:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0962436a-8b79-4459-ac6c-1e8f5dfc6d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0962436a-8b79-4459-ac6c-1e8f5dfc6d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1670597714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06708860-1209-4026-867e-2861c1c0a271,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f5417c765e7a45c384b13fc0f4229024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:35:50Z,use_quota=True,user_id='c5288bcc4f954814827ac5a84461928b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a42db2f-f222-4a3f-a3e7-6f62ec13b704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a42db2f-f222-4a3f-a3e7-6f62ec13b704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74fc2025-97bd-4bd6-b8bd-f970cc3b570f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74fc2025-97bd-4bd6-b8bd-f970cc3b570f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06708860-1209-4026-867e-2861c1c0a271', 'volume_name': 'volume-06708860-1209-4026-867e-2861c1c0a271', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d36e1f-0f96-4c31-ab36-e68816fd409e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d36e1f-0f96-4c31-ab36-e68816fd409e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bafacfb-5636-4455-a76d-d2ea65644a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:50 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Volume 06708860-1209-4026-867e-2861c1c0a271: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06708860-1209-4026-867e-2861c1c0a271', 'volume_size': 1} Sep 10 15:35:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:35:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:35:50 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1670597714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06708860-1209-4026-867e-2861c1c0a271,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f5417c765e7a45c384b13fc0f4229024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:35:50Z,use_quota=True,user_id='c5288bcc4f954814827ac5a84461928b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:35:50 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Creating volume 06708860-1209-4026-867e-2861c1c0a271 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:35:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:35:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:35:50 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:35:50 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:35:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:35:50 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:35:50 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:35:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-06708860-1209-4026-867e-2861c1c0a271 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:50 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d5aae2fc-ea1d-42a7-a032-a985806e0743 tempest-VolumesListAdminTestJSON-844315908 None] Acquiring lock "cinder-b3dde7ce-facf-459f-b281-732938721db3-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:35:50 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=70, name=volume-06708860-1209-4026-867e-2861c1c0a271, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:35:50 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d5aae2fc-ea1d-42a7-a032-a985806e0743 tempest-VolumesListAdminTestJSON-844315908 None] Lock "cinder-b3dde7ce-facf-459f-b281-732938721db3-delete_volume" acquired by "delete_volume" :: waited 0.190s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:35:50 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-d5aae2fc-ea1d-42a7-a032-a985806e0743 tempest-VolumesListAdminTestJSON-844315908 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:35:50 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d5aae2fc-ea1d-42a7-a032-a985806e0743 tempest-VolumesListAdminTestJSON-844315908 None] Acquiring lock "cinder-quobyte-b3dde7ce-facf-459f-b281-732938721db3" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:35:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-06708860-1209-4026-867e-2861c1c0a271 1073741824" returned: 0 in 0.746s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-06708860-1209-4026-867e-2861c1c0a271 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:51 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d5aae2fc-ea1d-42a7-a032-a985806e0743 tempest-VolumesListAdminTestJSON-844315908 None] Lock "cinder-quobyte-b3dde7ce-facf-459f-b281-732938721db3" acquired by "delete_volume" :: waited 0.254s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:35:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-06708860-1209-4026-867e-2861c1c0a271" returned: 0 in 0.288s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:51 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] <== create_volume: return (1051ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:35:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:35:51 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1d5a14-3217-4c67-b280-433221a27a74]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:35:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d5aae2fc-ea1d-42a7-a032-a985806e0743 tempest-VolumesListAdminTestJSON-844315908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b3dde7ce-facf-459f-b281-732938721db3 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bafacfb-5636-4455-a76d-d2ea65644a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06708860-1209-4026-867e-2861c1c0a271', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6918797b-6ee1-4542-a41a-3ac623a8a5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:35:51 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Volume volume-06708860-1209-4026-867e-2861c1c0a271 (06708860-1209-4026-867e-2861c1c0a271): created successfully Sep 10 15:35:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6918797b-6ee1-4542-a41a-3ac623a8a5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:35:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Flow 'volume_create_manager' (5313397d-765c-4a14-9b3b-ed095fa67c74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:35:51 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-099875b6-abec-4973-bb71-c29a3f388e48 tempest-VolumesListTestJSON-217870622 None] Created volume successfully. Sep 10 15:35:51 devstack quobyte-client[82814]: System call of process 92634 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:35:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d5aae2fc-ea1d-42a7-a032-a985806e0743 tempest-VolumesListAdminTestJSON-844315908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b3dde7ce-facf-459f-b281-732938721db3" returned: 0 in 0.771s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d5aae2fc-ea1d-42a7-a032-a985806e0743 tempest-VolumesListAdminTestJSON-844315908 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b3dde7ce-facf-459f-b281-732938721db3 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d5aae2fc-ea1d-42a7-a032-a985806e0743 tempest-VolumesListAdminTestJSON-844315908 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b3dde7ce-facf-459f-b281-732938721db3" returned: 0 in 0.113s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:52 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d5aae2fc-ea1d-42a7-a032-a985806e0743 tempest-VolumesListAdminTestJSON-844315908 None] Lock "cinder-quobyte-b3dde7ce-facf-459f-b281-732938721db3" released by "delete_volume" :: held 1.245s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:35:52 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-d5aae2fc-ea1d-42a7-a032-a985806e0743 tempest-VolumesListAdminTestJSON-844315908 None] Created reservations ['9345ab82-b211-4535-9bef-41c3e774eeb7', 'a74aaf99-1546-41fa-829f-25e723db9c95', 'f0356046-c20b-4d98-9cd3-6410a8b72950', 'dcb987f5-aa3d-4f56-a6ae-019a3f16efcd'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:35:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d5aae2fc-ea1d-42a7-a032-a985806e0743 tempest-VolumesListAdminTestJSON-844315908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:35:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d5aae2fc-ea1d-42a7-a032-a985806e0743 tempest-VolumesListAdminTestJSON-844315908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:35:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d5aae2fc-ea1d-42a7-a032-a985806e0743 tempest-VolumesListAdminTestJSON-844315908 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:35:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d5aae2fc-ea1d-42a7-a032-a985806e0743 tempest-VolumesListAdminTestJSON-844315908 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:35:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d5aae2fc-ea1d-42a7-a032-a985806e0743 tempest-VolumesListAdminTestJSON-844315908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:35:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d5aae2fc-ea1d-42a7-a032-a985806e0743 tempest-VolumesListAdminTestJSON-844315908 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d5aae2fc-ea1d-42a7-a032-a985806e0743 tempest-VolumesListAdminTestJSON-844315908 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.159s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:35:53 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-d5aae2fc-ea1d-42a7-a032-a985806e0743 tempest-VolumesListAdminTestJSON-844315908 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:35:53 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-d5aae2fc-ea1d-42a7-a032-a985806e0743 tempest-VolumesListAdminTestJSON-844315908 None] Deleted volume successfully. Sep 10 15:35:53 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d5aae2fc-ea1d-42a7-a032-a985806e0743 tempest-VolumesListAdminTestJSON-844315908 None] Lock "cinder-b3dde7ce-facf-459f-b281-732938721db3-delete_volume" released by "delete_volume" :: held 3.263s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:35:58 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a29339bf-757a-4cb8-9a13-13c1ebe5bdd1 tempest-VolumesListTestJSON-217870622 None] Acquiring lock "cinder-06708860-1209-4026-867e-2861c1c0a271-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:35:58 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a29339bf-757a-4cb8-9a13-13c1ebe5bdd1 tempest-VolumesListTestJSON-217870622 None] Lock "cinder-06708860-1209-4026-867e-2861c1c0a271-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:35:59 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-a29339bf-757a-4cb8-9a13-13c1ebe5bdd1 tempest-VolumesListTestJSON-217870622 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:35:59 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a29339bf-757a-4cb8-9a13-13c1ebe5bdd1 tempest-VolumesListTestJSON-217870622 None] Acquiring lock "cinder-quobyte-06708860-1209-4026-867e-2861c1c0a271" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:35:59 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a29339bf-757a-4cb8-9a13-13c1ebe5bdd1 tempest-VolumesListTestJSON-217870622 None] Lock "cinder-quobyte-06708860-1209-4026-867e-2861c1c0a271" acquired by "delete_volume" :: waited 0.046s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:35:59 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f684e5e-3320-4684-a970-d4da426eea54]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:35:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a29339bf-757a-4cb8-9a13-13c1ebe5bdd1 tempest-VolumesListTestJSON-217870622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-06708860-1209-4026-867e-2861c1c0a271 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:35:59 devstack quobyte-client[82814]: System call of process 92640 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:35:59 devstack quobyte-client[82814]: System call of process 92640 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:36:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a29339bf-757a-4cb8-9a13-13c1ebe5bdd1 tempest-VolumesListTestJSON-217870622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-06708860-1209-4026-867e-2861c1c0a271" returned: 0 in 0.840s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a29339bf-757a-4cb8-9a13-13c1ebe5bdd1 tempest-VolumesListTestJSON-217870622 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-06708860-1209-4026-867e-2861c1c0a271 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a29339bf-757a-4cb8-9a13-13c1ebe5bdd1 tempest-VolumesListTestJSON-217870622 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-06708860-1209-4026-867e-2861c1c0a271" returned: 0 in 0.138s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:00 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a29339bf-757a-4cb8-9a13-13c1ebe5bdd1 tempest-VolumesListTestJSON-217870622 None] Lock "cinder-quobyte-06708860-1209-4026-867e-2861c1c0a271" released by "delete_volume" :: held 1.240s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:36:00 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-a29339bf-757a-4cb8-9a13-13c1ebe5bdd1 tempest-VolumesListTestJSON-217870622 None] Created reservations ['848dd69c-b4de-4e85-9f99-31f2f9c444da', 'e40c856a-ee7b-4dfd-b3cd-c4d6b9957478', '312841ac-6611-418e-9121-a7a700653a60', 'e3c79ba2-2fcd-4763-8770-2a10909dfa50'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:36:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a29339bf-757a-4cb8-9a13-13c1ebe5bdd1 tempest-VolumesListTestJSON-217870622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:36:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a29339bf-757a-4cb8-9a13-13c1ebe5bdd1 tempest-VolumesListTestJSON-217870622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:36:01 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a29339bf-757a-4cb8-9a13-13c1ebe5bdd1 tempest-VolumesListTestJSON-217870622 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:36:01 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a29339bf-757a-4cb8-9a13-13c1ebe5bdd1 tempest-VolumesListTestJSON-217870622 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:36:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a29339bf-757a-4cb8-9a13-13c1ebe5bdd1 tempest-VolumesListTestJSON-217870622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:36:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a29339bf-757a-4cb8-9a13-13c1ebe5bdd1 tempest-VolumesListTestJSON-217870622 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-aa2ab142-e455-4d57-9faa-6063fbf6fdb0 tempest-VolumesListTestJSON-217870622 None] Acquiring lock "cinder-8e569662-518c-4747-a21b-ae2b48d0aa60-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:36:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a29339bf-757a-4cb8-9a13-13c1ebe5bdd1 tempest-VolumesListTestJSON-217870622 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.769s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:02 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-a29339bf-757a-4cb8-9a13-13c1ebe5bdd1 tempest-VolumesListTestJSON-217870622 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:36:02 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-aa2ab142-e455-4d57-9faa-6063fbf6fdb0 tempest-VolumesListTestJSON-217870622 None] Lock "cinder-8e569662-518c-4747-a21b-ae2b48d0aa60-delete_volume" acquired by "delete_volume" :: waited 0.256s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:36:02 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-a29339bf-757a-4cb8-9a13-13c1ebe5bdd1 tempest-VolumesListTestJSON-217870622 None] Deleted volume successfully. Sep 10 15:36:02 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-aa2ab142-e455-4d57-9faa-6063fbf6fdb0 tempest-VolumesListTestJSON-217870622 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:36:02 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-aa2ab142-e455-4d57-9faa-6063fbf6fdb0 tempest-VolumesListTestJSON-217870622 None] Acquiring lock "cinder-quobyte-8e569662-518c-4747-a21b-ae2b48d0aa60" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:36:02 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a29339bf-757a-4cb8-9a13-13c1ebe5bdd1 tempest-VolumesListTestJSON-217870622 None] Lock "cinder-06708860-1209-4026-867e-2861c1c0a271-delete_volume" released by "delete_volume" :: held 3.744s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:36:02 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-aa2ab142-e455-4d57-9faa-6063fbf6fdb0 tempest-VolumesListTestJSON-217870622 None] Lock "cinder-quobyte-8e569662-518c-4747-a21b-ae2b48d0aa60" acquired by "delete_volume" :: waited 0.043s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:36:02 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed3594c-87fd-4aaa-9a2a-0fad1ffa5838]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:36:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa2ab142-e455-4d57-9faa-6063fbf6fdb0 tempest-VolumesListTestJSON-217870622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8e569662-518c-4747-a21b-ae2b48d0aa60 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa2ab142-e455-4d57-9faa-6063fbf6fdb0 tempest-VolumesListTestJSON-217870622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8e569662-518c-4747-a21b-ae2b48d0aa60" returned: 0 in 1.019s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa2ab142-e455-4d57-9faa-6063fbf6fdb0 tempest-VolumesListTestJSON-217870622 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8e569662-518c-4747-a21b-ae2b48d0aa60 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa2ab142-e455-4d57-9faa-6063fbf6fdb0 tempest-VolumesListTestJSON-217870622 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8e569662-518c-4747-a21b-ae2b48d0aa60" returned: 0 in 0.189s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:04 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-aa2ab142-e455-4d57-9faa-6063fbf6fdb0 tempest-VolumesListTestJSON-217870622 None] Lock "cinder-quobyte-8e569662-518c-4747-a21b-ae2b48d0aa60" released by "delete_volume" :: held 1.652s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:36:04 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-aa2ab142-e455-4d57-9faa-6063fbf6fdb0 tempest-VolumesListTestJSON-217870622 None] Created reservations ['b923d15a-3481-4b5d-8264-f02252f6a38c', 'b4e0ffce-d06b-4f53-aa78-75a9965fc4b4', '3d862a64-2db6-40b2-bdaf-d5e71bfa3c21', '45f843da-90d5-417a-b641-007a40198ba4'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:36:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa2ab142-e455-4d57-9faa-6063fbf6fdb0 tempest-VolumesListTestJSON-217870622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:36:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa2ab142-e455-4d57-9faa-6063fbf6fdb0 tempest-VolumesListTestJSON-217870622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:36:04 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa2ab142-e455-4d57-9faa-6063fbf6fdb0 tempest-VolumesListTestJSON-217870622 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:36:04 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa2ab142-e455-4d57-9faa-6063fbf6fdb0 tempest-VolumesListTestJSON-217870622 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:36:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa2ab142-e455-4d57-9faa-6063fbf6fdb0 tempest-VolumesListTestJSON-217870622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:36:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa2ab142-e455-4d57-9faa-6063fbf6fdb0 tempest-VolumesListTestJSON-217870622 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa2ab142-e455-4d57-9faa-6063fbf6fdb0 tempest-VolumesListTestJSON-217870622 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.150s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:05 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa2ab142-e455-4d57-9faa-6063fbf6fdb0 tempest-VolumesListTestJSON-217870622 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:36:05 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-aa2ab142-e455-4d57-9faa-6063fbf6fdb0 tempest-VolumesListTestJSON-217870622 None] Deleted volume successfully. Sep 10 15:36:05 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-18546a55-fa3d-41b9-8610-7f5e9db259ed tempest-VolumesListTestJSON-217870622 None] Acquiring lock "cinder-99059a61-a304-43ad-8af0-eb34ad38bbfa-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:36:05 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-aa2ab142-e455-4d57-9faa-6063fbf6fdb0 tempest-VolumesListTestJSON-217870622 None] Lock "cinder-8e569662-518c-4747-a21b-ae2b48d0aa60-delete_volume" released by "delete_volume" :: held 3.756s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:36:05 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-18546a55-fa3d-41b9-8610-7f5e9db259ed tempest-VolumesListTestJSON-217870622 None] Lock "cinder-99059a61-a304-43ad-8af0-eb34ad38bbfa-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:36:06 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-18546a55-fa3d-41b9-8610-7f5e9db259ed tempest-VolumesListTestJSON-217870622 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:36:06 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-18546a55-fa3d-41b9-8610-7f5e9db259ed tempest-VolumesListTestJSON-217870622 None] Acquiring lock "cinder-quobyte-99059a61-a304-43ad-8af0-eb34ad38bbfa" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:36:06 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-18546a55-fa3d-41b9-8610-7f5e9db259ed tempest-VolumesListTestJSON-217870622 None] Lock "cinder-quobyte-99059a61-a304-43ad-8af0-eb34ad38bbfa" acquired by "delete_volume" :: waited 0.015s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:36:06 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[5341c5bc-ba31-4541-a26f-5590c4fb7be8]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:36:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-18546a55-fa3d-41b9-8610-7f5e9db259ed tempest-VolumesListTestJSON-217870622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-99059a61-a304-43ad-8af0-eb34ad38bbfa {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-18546a55-fa3d-41b9-8610-7f5e9db259ed tempest-VolumesListTestJSON-217870622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-99059a61-a304-43ad-8af0-eb34ad38bbfa" returned: 0 in 1.003s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-18546a55-fa3d-41b9-8610-7f5e9db259ed tempest-VolumesListTestJSON-217870622 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-99059a61-a304-43ad-8af0-eb34ad38bbfa {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-18546a55-fa3d-41b9-8610-7f5e9db259ed tempest-VolumesListTestJSON-217870622 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-99059a61-a304-43ad-8af0-eb34ad38bbfa" returned: 0 in 0.184s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:07 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-18546a55-fa3d-41b9-8610-7f5e9db259ed tempest-VolumesListTestJSON-217870622 None] Lock "cinder-quobyte-99059a61-a304-43ad-8af0-eb34ad38bbfa" released by "delete_volume" :: held 1.552s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:36:08 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-18546a55-fa3d-41b9-8610-7f5e9db259ed tempest-VolumesListTestJSON-217870622 None] Created reservations ['cf446490-7f80-4822-ae3b-68a1a45d3248', '7b1864dc-89a4-472c-a217-c2c40d32d76f', 'c7a3c8c8-f154-468b-bbe8-d969ef85415d', 'bed1a9fb-bc8c-4e82-8d55-ee7ec8ea036f'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-18546a55-fa3d-41b9-8610-7f5e9db259ed tempest-VolumesListTestJSON-217870622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-18546a55-fa3d-41b9-8610-7f5e9db259ed tempest-VolumesListTestJSON-217870622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-18546a55-fa3d-41b9-8610-7f5e9db259ed tempest-VolumesListTestJSON-217870622 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-18546a55-fa3d-41b9-8610-7f5e9db259ed tempest-VolumesListTestJSON-217870622 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-18546a55-fa3d-41b9-8610-7f5e9db259ed tempest-VolumesListTestJSON-217870622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-18546a55-fa3d-41b9-8610-7f5e9db259ed tempest-VolumesListTestJSON-217870622 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:09 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Flow 'volume_create_manager' (fed7ff6f-83b5-48ea-903a-5e34ea8f3fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452ba691-1ddc-4fc8-9e31-ef78c394cff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-18546a55-fa3d-41b9-8610-7f5e9db259ed tempest-VolumesListTestJSON-217870622 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.675s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-18546a55-fa3d-41b9-8610-7f5e9db259ed tempest-VolumesListTestJSON-217870622 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452ba691-1ddc-4fc8-9e31-ef78c394cff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-617057651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e931d7-bab2-44ad-b0b0-5953803d3ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21901774063640f28ab8daad583a660f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:36:09Z,use_quota=True,user_id='b2ce3f59cc4c43aaad1a58db955f6e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e500b6ef-111f-42e0-9057-7f105c9336e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e500b6ef-111f-42e0-9057-7f105c9336e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8eed85-5dca-4d51-9ae7-5fd13a2a2c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8eed85-5dca-4d51-9ae7-5fd13a2a2c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6e931d7-bab2-44ad-b0b0-5953803d3ab4', 'volume_name': 'volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23af9de7-aad9-40af-aff7-a3020d6f19bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23af9de7-aad9-40af-aff7-a3020d6f19bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (909784dc-f9fb-44b7-b9b4-8836608ea98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:36:09 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Volume c6e931d7-bab2-44ad-b0b0-5953803d3ab4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4', 'volume_size': 1} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-617057651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6e931d7-bab2-44ad-b0b0-5953803d3ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21901774063640f28ab8daad583a660f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:36:09Z,use_quota=True,user_id='b2ce3f59cc4c43aaad1a58db955f6e22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Creating volume c6e931d7-bab2-44ad-b0b0-5953803d3ab4 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:36:09 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:36:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:10 devstack quobyte-client[82814]: System call of process 92712 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:36:10 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-18546a55-fa3d-41b9-8610-7f5e9db259ed tempest-VolumesListTestJSON-217870622 None] Deleted volume successfully. Sep 10 15:36:10 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=71, name=volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:36:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4 1073741824" returned: 0 in 0.573s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:10 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-18546a55-fa3d-41b9-8610-7f5e9db259ed tempest-VolumesListTestJSON-217870622 None] Lock "cinder-99059a61-a304-43ad-8af0-eb34ad38bbfa-delete_volume" released by "delete_volume" :: held 4.829s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:36:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4" returned: 0 in 0.309s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:10 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] <== create_volume: return (929ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:36:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:36:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (909784dc-f9fb-44b7-b9b4-8836608ea98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:36:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87dd95b5-f6ca-409e-b05c-0dd594db0d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:36:11 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Volume volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4 (c6e931d7-bab2-44ad-b0b0-5953803d3ab4): created successfully Sep 10 15:36:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87dd95b5-f6ca-409e-b05c-0dd594db0d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:36:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Flow 'volume_create_manager' (fed7ff6f-83b5-48ea-903a-5e34ea8f3fbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:36:11 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-6b9e41c0-cb65-4bca-ae71-91112bf886d4 tempest-SnapshotMetadataTestJSON-249107401 None] Created volume successfully. Sep 10 15:36:12 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-81078f1d-52e7-45d5-b508-51d7cec46ac1 tempest-SnapshotMetadataTestJSON-249107401 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:36:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-81078f1d-52e7-45d5-b508-51d7cec46ac1 tempest-SnapshotMetadataTestJSON-249107401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:36:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-81078f1d-52e7-45d5-b508-51d7cec46ac1 tempest-SnapshotMetadataTestJSON-249107401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:36:12 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-81078f1d-52e7-45d5-b508-51d7cec46ac1 tempest-SnapshotMetadataTestJSON-249107401 None] Creating offline snapshot 5c9df2d2-5b45-44d9-bca5-1d212cd55072 of volume c6e931d7-bab2-44ad-b0b0-5953803d3ab4 {{(pid=82800) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 15:36:12 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[89da4e88-89c2-4cbf-be37-84f43fb75b48]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:36:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-81078f1d-52e7-45d5-b508-51d7cec46ac1 tempest-SnapshotMetadataTestJSON-249107401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:13 devstack quobyte-client[82814]: System call of process 92717 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:36:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-81078f1d-52e7-45d5-b508-51d7cec46ac1 tempest-SnapshotMetadataTestJSON-249107401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4" returned: 0 in 1.053s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-81078f1d-52e7-45d5-b508-51d7cec46ac1 tempest-SnapshotMetadataTestJSON-249107401 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4.5c9df2d2-5b45-44d9-bca5-1d212cd55072 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:14 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=72, name=volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4.5c9df2d2-5b45-44d9-bca5-1d212cd55072, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:36:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-81078f1d-52e7-45d5-b508-51d7cec46ac1 tempest-SnapshotMetadataTestJSON-249107401 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4.5c9df2d2-5b45-44d9-bca5-1d212cd55072 1G" returned: 0 in 0.617s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-81078f1d-52e7-45d5-b508-51d7cec46ac1 tempest-SnapshotMetadataTestJSON-249107401 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4.5c9df2d2-5b45-44d9-bca5-1d212cd55072 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-81078f1d-52e7-45d5-b508-51d7cec46ac1 tempest-SnapshotMetadataTestJSON-249107401 None] CMD "qemu-img rebase -u -b volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4.5c9df2d2-5b45-44d9-bca5-1d212cd55072" returned: 0 in 0.264s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:15 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-81078f1d-52e7-45d5-b508-51d7cec46ac1 tempest-SnapshotMetadataTestJSON-249107401 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4.5c9df2d2-5b45-44d9-bca5-1d212cd55072 is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:36:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-81078f1d-52e7-45d5-b508-51d7cec46ac1 tempest-SnapshotMetadataTestJSON-249107401 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4.5c9df2d2-5b45-44d9-bca5-1d212cd55072 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:15 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=54,cinder:UPDATE=89,cinder:INSERT=13,cinder:DELETE=9 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:36:15 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=103,cinder:DELETE=9,cinder:SELECT=67,cinder:INSERT=27 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:36:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-81078f1d-52e7-45d5-b508-51d7cec46ac1 tempest-SnapshotMetadataTestJSON-249107401 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4.5c9df2d2-5b45-44d9-bca5-1d212cd55072" returned: 0 in 0.377s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:15 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-81078f1d-52e7-45d5-b508-51d7cec46ac1 tempest-SnapshotMetadataTestJSON-249107401 None] Setting permissions: /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4 -> 1000:1000 {{(pid=82800) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 15:36:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-81078f1d-52e7-45d5-b508-51d7cec46ac1 tempest-SnapshotMetadataTestJSON-249107401 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4.5c9df2d2-5b45-44d9-bca5-1d212cd55072 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:15 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:36:15 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:36:15 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Flow 'volume_create_manager' (0bde6b62-1181-458e-b85f-19a8e3a7e306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:36:15 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b94aef7-758f-4467-bca1-3b389ed170d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:36:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-81078f1d-52e7-45d5-b508-51d7cec46ac1 tempest-SnapshotMetadataTestJSON-249107401 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4.5c9df2d2-5b45-44d9-bca5-1d212cd55072" returned: 0 in 0.466s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-81078f1d-52e7-45d5-b508-51d7cec46ac1 tempest-SnapshotMetadataTestJSON-249107401 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b94aef7-758f-4467-bca1-3b389ed170d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-643241722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dcf8871-a55c-4969-9eed-6a9ff820a240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='204543c5b791495a95bf092ba1082838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:36:15Z,use_quota=True,user_id='c2091f9b36834fda9f574732158be0a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:36:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a137b396-78eb-42a1-ab37-81545b43bb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:36:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a137b396-78eb-42a1-ab37-81545b43bb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:36:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c9e15f-acdc-4912-b883-0c87f634797e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:36:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c9e15f-acdc-4912-b883-0c87f634797e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dcf8871-a55c-4969-9eed-6a9ff820a240', 'volume_name': 'volume-7dcf8871-a55c-4969-9eed-6a9ff820a240', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:36:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b0fabda-e97f-48f0-a263-ec4607cfabe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:36:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b0fabda-e97f-48f0-a263-ec4607cfabe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:36:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c592ad9-760c-47a9-94ef-7db6c1aa602b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:36:16 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Volume 7dcf8871-a55c-4969-9eed-6a9ff820a240: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dcf8871-a55c-4969-9eed-6a9ff820a240', 'volume_size': 1} Sep 10 15:36:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:36:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-81078f1d-52e7-45d5-b508-51d7cec46ac1 tempest-SnapshotMetadataTestJSON-249107401 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4.info" returned: 0 in 0.359s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:16 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-81078f1d-52e7-45d5-b508-51d7cec46ac1 tempest-SnapshotMetadataTestJSON-249107401 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4.info is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:36:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-81078f1d-52e7-45d5-b508-51d7cec46ac1 tempest-SnapshotMetadataTestJSON-249107401 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-81078f1d-52e7-45d5-b508-51d7cec46ac1 tempest-SnapshotMetadataTestJSON-249107401 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4.info" returned: 0 in 0.156s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-81078f1d-52e7-45d5-b508-51d7cec46ac1 tempest-SnapshotMetadataTestJSON-249107401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.739s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:36:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.414s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:36:16 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-643241722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dcf8871-a55c-4969-9eed-6a9ff820a240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='204543c5b791495a95bf092ba1082838',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:36:15Z,use_quota=True,user_id='c2091f9b36834fda9f574732158be0a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:36:16 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Creating volume 7dcf8871-a55c-4969-9eed-6a9ff820a240 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:36:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:36:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:36:16 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:36:16 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:36:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:36:16 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:36:16 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:36:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:17 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=74, name=volume-7dcf8871-a55c-4969-9eed-6a9ff820a240, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:36:17 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-81078f1d-52e7-45d5-b508-51d7cec46ac1 tempest-SnapshotMetadataTestJSON-249107401 None] Create snapshot completed successfully Sep 10 15:36:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240 1073741824" returned: 0 in 0.584s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240" returned: 0 in 0.079s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:17 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] <== create_volume: return (714ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:36:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:36:17 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c592ad9-760c-47a9-94ef-7db6c1aa602b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dcf8871-a55c-4969-9eed-6a9ff820a240', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:36:17 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376be080-679d-422b-8ca7-e7794186f5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:36:17 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Volume volume-7dcf8871-a55c-4969-9eed-6a9ff820a240 (7dcf8871-a55c-4969-9eed-6a9ff820a240): created successfully Sep 10 15:36:17 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (376be080-679d-422b-8ca7-e7794186f5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:36:17 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Flow 'volume_create_manager' (0bde6b62-1181-458e-b85f-19a8e3a7e306) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:36:17 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-41ea8600-f779-4da5-ba8c-29d527fb3e2a tempest-VolumesSnapshotListTestJSON-949421808 None] Created volume successfully. Sep 10 15:36:19 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-42ec9948-5270-4bdc-bcb6-6dbe46e1314c tempest-VolumesSnapshotListTestJSON-949421808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:36:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-42ec9948-5270-4bdc-bcb6-6dbe46e1314c tempest-VolumesSnapshotListTestJSON-949421808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:36:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-42ec9948-5270-4bdc-bcb6-6dbe46e1314c tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:36:19 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-42ec9948-5270-4bdc-bcb6-6dbe46e1314c tempest-VolumesSnapshotListTestJSON-949421808 None] Creating offline snapshot d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8 of volume 7dcf8871-a55c-4969-9eed-6a9ff820a240 {{(pid=82800) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 15:36:19 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[601b9030-84fe-43d8-a5e7-ca10c2ed04de]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:36:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-42ec9948-5270-4bdc-bcb6-6dbe46e1314c tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:19 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-5b6e37f6-1461-4f9a-8819-0c7af53c6609 tempest-SnapshotMetadataTestJSON-249107401 None] Acquiring lock "cinder-5c9df2d2-5b45-44d9-bca5-1d212cd55072-delete_snapshot" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:36:19 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-5b6e37f6-1461-4f9a-8819-0c7af53c6609 tempest-SnapshotMetadataTestJSON-249107401 None] Lock "cinder-5c9df2d2-5b45-44d9-bca5-1d212cd55072-delete_snapshot" acquired by "delete_snapshot" :: waited 0.107s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:36:19 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-5b6e37f6-1461-4f9a-8819-0c7af53c6609 tempest-SnapshotMetadataTestJSON-249107401 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:36:19 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-5b6e37f6-1461-4f9a-8819-0c7af53c6609 tempest-SnapshotMetadataTestJSON-249107401 None] Acquiring lock "cinder-quobyte-c6e931d7-bab2-44ad-b0b0-5953803d3ab4" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:36:20 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-5b6e37f6-1461-4f9a-8819-0c7af53c6609 tempest-SnapshotMetadataTestJSON-249107401 None] Lock "cinder-quobyte-c6e931d7-bab2-44ad-b0b0-5953803d3ab4" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:36:20 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-5b6e37f6-1461-4f9a-8819-0c7af53c6609 tempest-SnapshotMetadataTestJSON-249107401 None] Acquiring lock "cinder-quobyte-5c9df2d2-5b45-44d9-bca5-1d212cd55072" by "_delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:36:20 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-5b6e37f6-1461-4f9a-8819-0c7af53c6609 tempest-SnapshotMetadataTestJSON-249107401 None] Lock "cinder-quobyte-5c9df2d2-5b45-44d9-bca5-1d212cd55072" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:36:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-5b6e37f6-1461-4f9a-8819-0c7af53c6609 tempest-SnapshotMetadataTestJSON-249107401 None] Deleting offline snapshot 5c9df2d2-5b45-44d9-bca5-1d212cd55072 of volume c6e931d7-bab2-44ad-b0b0-5953803d3ab4 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 15:36:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-5b6e37f6-1461-4f9a-8819-0c7af53c6609 tempest-SnapshotMetadataTestJSON-249107401 None] snapshot_file for this snap is: volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4.5c9df2d2-5b45-44d9-bca5-1d212cd55072 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 15:36:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-42ec9948-5270-4bdc-bcb6-6dbe46e1314c tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240" returned: 0 in 0.666s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-42ec9948-5270-4bdc-bcb6-6dbe46e1314c tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:20 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[612c2ef8-be2f-402c-b8e0-67fd4fed7056]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:36:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b6e37f6-1461-4f9a-8819-0c7af53c6609 tempest-SnapshotMetadataTestJSON-249107401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4.5c9df2d2-5b45-44d9-bca5-1d212cd55072 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:20 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=75, name=volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:36:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-42ec9948-5270-4bdc-bcb6-6dbe46e1314c tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8 1G" returned: 0 in 0.307s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-42ec9948-5270-4bdc-bcb6-6dbe46e1314c tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7dcf8871-a55c-4969-9eed-6a9ff820a240 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-42ec9948-5270-4bdc-bcb6-6dbe46e1314c tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "qemu-img rebase -u -b volume-7dcf8871-a55c-4969-9eed-6a9ff820a240 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8" returned: 0 in 0.200s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-42ec9948-5270-4bdc-bcb6-6dbe46e1314c tempest-VolumesSnapshotListTestJSON-949421808 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8 is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:36:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-42ec9948-5270-4bdc-bcb6-6dbe46e1314c tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b6e37f6-1461-4f9a-8819-0c7af53c6609 tempest-SnapshotMetadataTestJSON-249107401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4.5c9df2d2-5b45-44d9-bca5-1d212cd55072" returned: 0 in 0.544s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-5b6e37f6-1461-4f9a-8819-0c7af53c6609 tempest-SnapshotMetadataTestJSON-249107401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:36:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-42ec9948-5270-4bdc-bcb6-6dbe46e1314c tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8" returned: 0 in 0.192s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-42ec9948-5270-4bdc-bcb6-6dbe46e1314c tempest-VolumesSnapshotListTestJSON-949421808 None] Setting permissions: /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240 -> 1000:1000 {{(pid=82800) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 15:36:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-42ec9948-5270-4bdc-bcb6-6dbe46e1314c tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:20 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c25633-3c9d-4267-a073-ee773ae5f261]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:36:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b6e37f6-1461-4f9a-8819-0c7af53c6609 tempest-SnapshotMetadataTestJSON-249107401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-42ec9948-5270-4bdc-bcb6-6dbe46e1314c tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8" returned: 0 in 0.199s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-42ec9948-5270-4bdc-bcb6-6dbe46e1314c tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-42ec9948-5270-4bdc-bcb6-6dbe46e1314c tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.info" returned: 0 in 0.106s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-42ec9948-5270-4bdc-bcb6-6dbe46e1314c tempest-VolumesSnapshotListTestJSON-949421808 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.info is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:36:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-42ec9948-5270-4bdc-bcb6-6dbe46e1314c tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-42ec9948-5270-4bdc-bcb6-6dbe46e1314c tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.info" returned: 0 in 0.137s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-42ec9948-5270-4bdc-bcb6-6dbe46e1314c tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.111s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:36:21 devstack quobyte-client[82814]: System call of process 92749 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:36:21 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-42ec9948-5270-4bdc-bcb6-6dbe46e1314c tempest-VolumesSnapshotListTestJSON-949421808 None] Create snapshot completed successfully Sep 10 15:36:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b6e37f6-1461-4f9a-8819-0c7af53c6609 tempest-SnapshotMetadataTestJSON-249107401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4" returned: 0 in 0.875s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b6e37f6-1461-4f9a-8819-0c7af53c6609 tempest-SnapshotMetadataTestJSON-249107401 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4.5c9df2d2-5b45-44d9-bca5-1d212cd55072 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:22 devstack quobyte-client[82814]: System call of process 92766 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:36:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b6e37f6-1461-4f9a-8819-0c7af53c6609 tempest-SnapshotMetadataTestJSON-249107401 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4.5c9df2d2-5b45-44d9-bca5-1d212cd55072" returned: 0 in 0.494s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b6e37f6-1461-4f9a-8819-0c7af53c6609 tempest-SnapshotMetadataTestJSON-249107401 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4.5c9df2d2-5b45-44d9-bca5-1d212cd55072 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5b6e37f6-1461-4f9a-8819-0c7af53c6609 tempest-SnapshotMetadataTestJSON-249107401 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4.5c9df2d2-5b45-44d9-bca5-1d212cd55072" returned: 0 in 0.193s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:22 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-5b6e37f6-1461-4f9a-8819-0c7af53c6609 tempest-SnapshotMetadataTestJSON-249107401 None] Lock "cinder-quobyte-5c9df2d2-5b45-44d9-bca5-1d212cd55072" released by "_delete_snapshot" :: held 2.798s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:36:22 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-5b6e37f6-1461-4f9a-8819-0c7af53c6609 tempest-SnapshotMetadataTestJSON-249107401 None] Lock "cinder-quobyte-c6e931d7-bab2-44ad-b0b0-5953803d3ab4" released by "delete_snapshot" :: held 2.827s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:36:23 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-93473118-85e3-429e-8ffa-7a7cd8b6536f tempest-VolumesSnapshotListTestJSON-949421808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:36:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-93473118-85e3-429e-8ffa-7a7cd8b6536f tempest-VolumesSnapshotListTestJSON-949421808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:36:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-93473118-85e3-429e-8ffa-7a7cd8b6536f tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:36:23 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-93473118-85e3-429e-8ffa-7a7cd8b6536f tempest-VolumesSnapshotListTestJSON-949421808 None] Creating offline snapshot d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8 of volume 7dcf8871-a55c-4969-9eed-6a9ff820a240 {{(pid=82800) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 15:36:23 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6faf92-5895-4c94-9327-a8c141a0345a]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:36:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-93473118-85e3-429e-8ffa-7a7cd8b6536f tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:23 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-5b6e37f6-1461-4f9a-8819-0c7af53c6609 tempest-SnapshotMetadataTestJSON-249107401 None] Created reservations ['ec754a41-28cf-47c2-b026-ad31e1900e04', '79746b63-e006-4071-bce3-a0a17dbe266e', '1f2573f7-6e29-47a9-8b4d-9391fe5e1de3', '9fcebbdb-2e3e-4d30-b1ed-61b936f9ef64'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:36:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-93473118-85e3-429e-8ffa-7a7cd8b6536f tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8" returned: 0 in 0.472s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:23 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-93473118-85e3-429e-8ffa-7a7cd8b6536f tempest-VolumesSnapshotListTestJSON-949421808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7dcf8871-a55c-4969-9eed-6a9ff820a240(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:36:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-93473118-85e3-429e-8ffa-7a7cd8b6536f tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:24 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-5b6e37f6-1461-4f9a-8819-0c7af53c6609 tempest-SnapshotMetadataTestJSON-249107401 None] Delete snapshot completed successfully. Sep 10 15:36:24 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-5b6e37f6-1461-4f9a-8819-0c7af53c6609 tempest-SnapshotMetadataTestJSON-249107401 None] Lock "cinder-5c9df2d2-5b45-44d9-bca5-1d212cd55072-delete_snapshot" released by "delete_snapshot" :: held 4.427s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:36:24 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=77, name=volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:36:24 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b9cc4ef6-7469-4099-b710-509b4f09c6a0 tempest-SnapshotMetadataTestJSON-249107401 None] Acquiring lock "cinder-c6e931d7-bab2-44ad-b0b0-5953803d3ab4-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:36:24 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b9cc4ef6-7469-4099-b710-509b4f09c6a0 tempest-SnapshotMetadataTestJSON-249107401 None] Lock "cinder-c6e931d7-bab2-44ad-b0b0-5953803d3ab4-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:36:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-93473118-85e3-429e-8ffa-7a7cd8b6536f tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8 1G" returned: 0 in 0.848s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-93473118-85e3-429e-8ffa-7a7cd8b6536f tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:24 devstack quobyte-client[82814]: System call of process 92796 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:36:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-93473118-85e3-429e-8ffa-7a7cd8b6536f tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "qemu-img rebase -u -b volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8" returned: 0 in 0.433s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-93473118-85e3-429e-8ffa-7a7cd8b6536f tempest-VolumesSnapshotListTestJSON-949421808 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8 is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:36:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-93473118-85e3-429e-8ffa-7a7cd8b6536f tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:25 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-b9cc4ef6-7469-4099-b710-509b4f09c6a0 tempest-SnapshotMetadataTestJSON-249107401 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:36:25 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b9cc4ef6-7469-4099-b710-509b4f09c6a0 tempest-SnapshotMetadataTestJSON-249107401 None] Acquiring lock "cinder-quobyte-c6e931d7-bab2-44ad-b0b0-5953803d3ab4" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:36:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-93473118-85e3-429e-8ffa-7a7cd8b6536f tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8" returned: 0 in 0.278s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-93473118-85e3-429e-8ffa-7a7cd8b6536f tempest-VolumesSnapshotListTestJSON-949421808 None] Setting permissions: /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8 -> 1000:1000 {{(pid=82800) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 15:36:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-93473118-85e3-429e-8ffa-7a7cd8b6536f tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:25 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b9cc4ef6-7469-4099-b710-509b4f09c6a0 tempest-SnapshotMetadataTestJSON-249107401 None] Lock "cinder-quobyte-c6e931d7-bab2-44ad-b0b0-5953803d3ab4" acquired by "delete_volume" :: waited 0.271s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:36:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-93473118-85e3-429e-8ffa-7a7cd8b6536f tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8" returned: 0 in 0.251s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-93473118-85e3-429e-8ffa-7a7cd8b6536f tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.558s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:36:25 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa4ed74-af81-4afd-a8cd-ea5bb38ba384]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:36:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b9cc4ef6-7469-4099-b710-509b4f09c6a0 tempest-SnapshotMetadataTestJSON-249107401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:26 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-93473118-85e3-429e-8ffa-7a7cd8b6536f tempest-VolumesSnapshotListTestJSON-949421808 None] Create snapshot completed successfully Sep 10 15:36:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b9cc4ef6-7469-4099-b710-509b4f09c6a0 tempest-SnapshotMetadataTestJSON-249107401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4" returned: 0 in 0.570s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b9cc4ef6-7469-4099-b710-509b4f09c6a0 tempest-SnapshotMetadataTestJSON-249107401 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b9cc4ef6-7469-4099-b710-509b4f09c6a0 tempest-SnapshotMetadataTestJSON-249107401 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c6e931d7-bab2-44ad-b0b0-5953803d3ab4" returned: 0 in 0.095s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:26 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b9cc4ef6-7469-4099-b710-509b4f09c6a0 tempest-SnapshotMetadataTestJSON-249107401 None] Lock "cinder-quobyte-c6e931d7-bab2-44ad-b0b0-5953803d3ab4" released by "delete_volume" :: held 1.046s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:36:27 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-b9cc4ef6-7469-4099-b710-509b4f09c6a0 tempest-SnapshotMetadataTestJSON-249107401 None] Created reservations ['39e2c57d-7e0e-4a03-859a-03d9df08446c', 'b2fb5888-1054-4389-87c3-f93244d9d6aa', 'e3833ff7-e2d3-49d7-8918-e3b6eba8c002', '9ace7bb8-b800-4f2f-bcdc-0b4efa4643c5'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:36:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b9cc4ef6-7469-4099-b710-509b4f09c6a0 tempest-SnapshotMetadataTestJSON-249107401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:36:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b9cc4ef6-7469-4099-b710-509b4f09c6a0 tempest-SnapshotMetadataTestJSON-249107401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:36:27 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b9cc4ef6-7469-4099-b710-509b4f09c6a0 tempest-SnapshotMetadataTestJSON-249107401 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:36:27 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b9cc4ef6-7469-4099-b710-509b4f09c6a0 tempest-SnapshotMetadataTestJSON-249107401 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:36:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b9cc4ef6-7469-4099-b710-509b4f09c6a0 tempest-SnapshotMetadataTestJSON-249107401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:36:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b9cc4ef6-7469-4099-b710-509b4f09c6a0 tempest-SnapshotMetadataTestJSON-249107401 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b9cc4ef6-7469-4099-b710-509b4f09c6a0 tempest-SnapshotMetadataTestJSON-249107401 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.175s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:27 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-b9cc4ef6-7469-4099-b710-509b4f09c6a0 tempest-SnapshotMetadataTestJSON-249107401 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:36:27 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-b9cc4ef6-7469-4099-b710-509b4f09c6a0 tempest-SnapshotMetadataTestJSON-249107401 None] Deleted volume successfully. Sep 10 15:36:27 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-dbf4bf9d-44bb-4fa4-83c2-08cd034e3bf0 tempest-VolumesSnapshotListTestJSON-949421808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:36:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-dbf4bf9d-44bb-4fa4-83c2-08cd034e3bf0 tempest-VolumesSnapshotListTestJSON-949421808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:36:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-dbf4bf9d-44bb-4fa4-83c2-08cd034e3bf0 tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:36:27 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b9cc4ef6-7469-4099-b710-509b4f09c6a0 tempest-SnapshotMetadataTestJSON-249107401 None] Lock "cinder-c6e931d7-bab2-44ad-b0b0-5953803d3ab4-delete_volume" released by "delete_volume" :: held 3.212s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:36:27 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-dbf4bf9d-44bb-4fa4-83c2-08cd034e3bf0 tempest-VolumesSnapshotListTestJSON-949421808 None] Creating offline snapshot 0d5c7ad6-55a4-42d4-9342-2fb8c136f29d of volume 7dcf8871-a55c-4969-9eed-6a9ff820a240 {{(pid=82800) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 15:36:27 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b90d31a-4106-4fd2-988a-b407d26244dd]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:36:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-dbf4bf9d-44bb-4fa4-83c2-08cd034e3bf0 tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-dbf4bf9d-44bb-4fa4-83c2-08cd034e3bf0 tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8" returned: 0 in 0.676s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-dbf4bf9d-44bb-4fa4-83c2-08cd034e3bf0 tempest-VolumesSnapshotListTestJSON-949421808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7dcf8871-a55c-4969-9eed-6a9ff820a240(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:36:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-dbf4bf9d-44bb-4fa4-83c2-08cd034e3bf0 tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.0d5c7ad6-55a4-42d4-9342-2fb8c136f29d 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:28 devstack quobyte-client[82814]: System call of process 92811 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:36:28 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=78, name=volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.0d5c7ad6-55a4-42d4-9342-2fb8c136f29d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:36:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-dbf4bf9d-44bb-4fa4-83c2-08cd034e3bf0 tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.0d5c7ad6-55a4-42d4-9342-2fb8c136f29d 1G" returned: 0 in 0.413s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-dbf4bf9d-44bb-4fa4-83c2-08cd034e3bf0 tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.0d5c7ad6-55a4-42d4-9342-2fb8c136f29d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:36:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:36:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:36:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:36:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:36:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:36:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-dbf4bf9d-44bb-4fa4-83c2-08cd034e3bf0 tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "qemu-img rebase -u -b volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.0d5c7ad6-55a4-42d4-9342-2fb8c136f29d" returned: 0 in 0.467s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-dbf4bf9d-44bb-4fa4-83c2-08cd034e3bf0 tempest-VolumesSnapshotListTestJSON-949421808 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.0d5c7ad6-55a4-42d4-9342-2fb8c136f29d is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:36:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-dbf4bf9d-44bb-4fa4-83c2-08cd034e3bf0 tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.0d5c7ad6-55a4-42d4-9342-2fb8c136f29d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.300s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:36:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-dbf4bf9d-44bb-4fa4-83c2-08cd034e3bf0 tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.0d5c7ad6-55a4-42d4-9342-2fb8c136f29d" returned: 0 in 0.255s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-dbf4bf9d-44bb-4fa4-83c2-08cd034e3bf0 tempest-VolumesSnapshotListTestJSON-949421808 None] Setting permissions: /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8 -> 1000:1000 {{(pid=82800) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 15:36:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-dbf4bf9d-44bb-4fa4-83c2-08cd034e3bf0 tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.0d5c7ad6-55a4-42d4-9342-2fb8c136f29d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-dbf4bf9d-44bb-4fa4-83c2-08cd034e3bf0 tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.0d5c7ad6-55a4-42d4-9342-2fb8c136f29d" returned: 0 in 0.169s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-dbf4bf9d-44bb-4fa4-83c2-08cd034e3bf0 tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.364s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:36:30 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-dbf4bf9d-44bb-4fa4-83c2-08cd034e3bf0 tempest-VolumesSnapshotListTestJSON-949421808 None] Create snapshot completed successfully Sep 10 15:36:33 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-86c0797d-52fe-4bed-8e7c-f398f192f0bb tempest-VolumesSnapshotListTestJSON-949421808 None] Acquiring lock "cinder-0d5c7ad6-55a4-42d4-9342-2fb8c136f29d-delete_snapshot" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:36:33 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-86c0797d-52fe-4bed-8e7c-f398f192f0bb tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "cinder-0d5c7ad6-55a4-42d4-9342-2fb8c136f29d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:36:33 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-86c0797d-52fe-4bed-8e7c-f398f192f0bb tempest-VolumesSnapshotListTestJSON-949421808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:36:33 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-86c0797d-52fe-4bed-8e7c-f398f192f0bb tempest-VolumesSnapshotListTestJSON-949421808 None] Acquiring lock "cinder-quobyte-7dcf8871-a55c-4969-9eed-6a9ff820a240" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:36:33 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-86c0797d-52fe-4bed-8e7c-f398f192f0bb tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "cinder-quobyte-7dcf8871-a55c-4969-9eed-6a9ff820a240" acquired by "delete_snapshot" :: waited 0.034s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:36:33 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-86c0797d-52fe-4bed-8e7c-f398f192f0bb tempest-VolumesSnapshotListTestJSON-949421808 None] Acquiring lock "cinder-quobyte-0d5c7ad6-55a4-42d4-9342-2fb8c136f29d" by "_delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:36:33 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-86c0797d-52fe-4bed-8e7c-f398f192f0bb tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "cinder-quobyte-0d5c7ad6-55a4-42d4-9342-2fb8c136f29d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:36:33 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-86c0797d-52fe-4bed-8e7c-f398f192f0bb tempest-VolumesSnapshotListTestJSON-949421808 None] Deleting offline snapshot 0d5c7ad6-55a4-42d4-9342-2fb8c136f29d of volume 7dcf8871-a55c-4969-9eed-6a9ff820a240 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 15:36:33 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-86c0797d-52fe-4bed-8e7c-f398f192f0bb tempest-VolumesSnapshotListTestJSON-949421808 None] snapshot_file for this snap is: volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.0d5c7ad6-55a4-42d4-9342-2fb8c136f29d {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 15:36:33 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[805ebdd8-ca74-447a-a25d-af407a1225ac]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:36:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-86c0797d-52fe-4bed-8e7c-f398f192f0bb tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.0d5c7ad6-55a4-42d4-9342-2fb8c136f29d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-86c0797d-52fe-4bed-8e7c-f398f192f0bb tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.0d5c7ad6-55a4-42d4-9342-2fb8c136f29d" returned: 0 in 0.526s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:33 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-86c0797d-52fe-4bed-8e7c-f398f192f0bb tempest-VolumesSnapshotListTestJSON-949421808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7dcf8871-a55c-4969-9eed-6a9ff820a240(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:36:33 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[592d4847-30f5-41a3-bdab-17e1563c8cb5]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:36:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-86c0797d-52fe-4bed-8e7c-f398f192f0bb tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:34 devstack quobyte-client[82814]: System call of process 92838 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:36:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-86c0797d-52fe-4bed-8e7c-f398f192f0bb tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8" returned: 0 in 0.624s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:34 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-86c0797d-52fe-4bed-8e7c-f398f192f0bb tempest-VolumesSnapshotListTestJSON-949421808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7dcf8871-a55c-4969-9eed-6a9ff820a240(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:36:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-86c0797d-52fe-4bed-8e7c-f398f192f0bb tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.0d5c7ad6-55a4-42d4-9342-2fb8c136f29d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-86c0797d-52fe-4bed-8e7c-f398f192f0bb tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.0d5c7ad6-55a4-42d4-9342-2fb8c136f29d" returned: 0 in 0.395s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-86c0797d-52fe-4bed-8e7c-f398f192f0bb tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.0d5c7ad6-55a4-42d4-9342-2fb8c136f29d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-86c0797d-52fe-4bed-8e7c-f398f192f0bb tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.0d5c7ad6-55a4-42d4-9342-2fb8c136f29d" returned: 0 in 0.120s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:35 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-86c0797d-52fe-4bed-8e7c-f398f192f0bb tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "cinder-quobyte-0d5c7ad6-55a4-42d4-9342-2fb8c136f29d" released by "_delete_snapshot" :: held 2.172s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:36:35 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-86c0797d-52fe-4bed-8e7c-f398f192f0bb tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "cinder-quobyte-7dcf8871-a55c-4969-9eed-6a9ff820a240" released by "delete_snapshot" :: held 2.203s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:36:35 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-86c0797d-52fe-4bed-8e7c-f398f192f0bb tempest-VolumesSnapshotListTestJSON-949421808 None] Created reservations ['2e09bcb9-b2d0-4597-bb88-1c887906ce53', 'e6b3aeee-b042-4195-8a15-9bffbac2845c', '67fabb1b-2722-4258-92fd-1ed6e7380e88', '231c254b-0dfd-4312-bff7-ab8f3a9efcda'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:36:35 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-86c0797d-52fe-4bed-8e7c-f398f192f0bb tempest-VolumesSnapshotListTestJSON-949421808 None] Delete snapshot completed successfully. Sep 10 15:36:35 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-86c0797d-52fe-4bed-8e7c-f398f192f0bb tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "cinder-0d5c7ad6-55a4-42d4-9342-2fb8c136f29d-delete_snapshot" released by "delete_snapshot" :: held 2.789s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:36:35 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:36:35 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:36:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Flow 'volume_create_manager' (f0c90e79-b9d7-4602-9727-2d6eaea65df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:36:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a265a068-7024-4f21-beb3-6cf4f3a053eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:36:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a265a068-7024-4f21-beb3-6cf4f3a053eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-894442245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd6fcba-854a-4df1-a874-e01c0869129d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2bf284dba148e3841c835c2072ab59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:36:36Z,use_quota=True,user_id='11634f5ee7814c03a546ef396a38efc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:36:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2283e3a8-ca04-4943-ab01-5c93a3f29f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:36:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2283e3a8-ca04-4943-ab01-5c93a3f29f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:36:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b467971d-3304-4e8d-b718-15c2341eb44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:36:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b467971d-3304-4e8d-b718-15c2341eb44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dd6fcba-854a-4df1-a874-e01c0869129d', 'volume_name': 'volume-6dd6fcba-854a-4df1-a874-e01c0869129d', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:36:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38083c53-fcc7-47d4-93a0-ab7bb314ac50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:36:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38083c53-fcc7-47d4-93a0-ab7bb314ac50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:36:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4480978c-ba95-4187-ab85-2760ff7d6a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:36:36 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Volume 6dd6fcba-854a-4df1-a874-e01c0869129d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dd6fcba-854a-4df1-a874-e01c0869129d', 'volume_size': 1} Sep 10 15:36:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:36:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:36:36 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-894442245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd6fcba-854a-4df1-a874-e01c0869129d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2bf284dba148e3841c835c2072ab59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:36:36Z,use_quota=True,user_id='11634f5ee7814c03a546ef396a38efc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:36:36 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Creating volume 6dd6fcba-854a-4df1-a874-e01c0869129d {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:36:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:36:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:36:36 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:36:36 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:36:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:36:36 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:36:36 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:36:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6dd6fcba-854a-4df1-a874-e01c0869129d 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:36 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=79, name=volume-6dd6fcba-854a-4df1-a874-e01c0869129d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:36:36 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-73394ce4-e9f1-482c-919e-a8a0225b52d9 tempest-VolumesSnapshotListTestJSON-949421808 None] Acquiring lock "cinder-d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8-delete_snapshot" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:36:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6dd6fcba-854a-4df1-a874-e01c0869129d 1073741824" returned: 0 in 0.590s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6dd6fcba-854a-4df1-a874-e01c0869129d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:36 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-73394ce4-e9f1-482c-919e-a8a0225b52d9 tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "cinder-d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.271s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:36:36 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-73394ce4-e9f1-482c-919e-a8a0225b52d9 tempest-VolumesSnapshotListTestJSON-949421808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:36:36 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-73394ce4-e9f1-482c-919e-a8a0225b52d9 tempest-VolumesSnapshotListTestJSON-949421808 None] Acquiring lock "cinder-quobyte-7dcf8871-a55c-4969-9eed-6a9ff820a240" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:36:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6dd6fcba-854a-4df1-a874-e01c0869129d" returned: 0 in 0.282s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:36 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] <== create_volume: return (896ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:36:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:36:37 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-73394ce4-e9f1-482c-919e-a8a0225b52d9 tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "cinder-quobyte-7dcf8871-a55c-4969-9eed-6a9ff820a240" acquired by "delete_snapshot" :: waited 0.167s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:36:37 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-73394ce4-e9f1-482c-919e-a8a0225b52d9 tempest-VolumesSnapshotListTestJSON-949421808 None] Acquiring lock "cinder-quobyte-d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8" by "_delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:36:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4480978c-ba95-4187-ab85-2760ff7d6a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dd6fcba-854a-4df1-a874-e01c0869129d', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:36:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8daf2b5a-8b3a-4bd3-afa1-4671fbca2060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:36:37 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-73394ce4-e9f1-482c-919e-a8a0225b52d9 tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "cinder-quobyte-d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8" acquired by "_delete_snapshot" :: waited 0.084s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:36:37 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-73394ce4-e9f1-482c-919e-a8a0225b52d9 tempest-VolumesSnapshotListTestJSON-949421808 None] Deleting offline snapshot d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8 of volume 7dcf8871-a55c-4969-9eed-6a9ff820a240 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 15:36:37 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-73394ce4-e9f1-482c-919e-a8a0225b52d9 tempest-VolumesSnapshotListTestJSON-949421808 None] snapshot_file for this snap is: volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 15:36:37 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Volume volume-6dd6fcba-854a-4df1-a874-e01c0869129d (6dd6fcba-854a-4df1-a874-e01c0869129d): created successfully Sep 10 15:36:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8daf2b5a-8b3a-4bd3-afa1-4671fbca2060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:36:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Flow 'volume_create_manager' (f0c90e79-b9d7-4602-9727-2d6eaea65df2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:36:37 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f34738-2361-43e4-b7cd-c4ed8c32ddd4]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:36:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-73394ce4-e9f1-482c-919e-a8a0225b52d9 tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:37 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-2ae286e4-bdfa-48f7-9ad4-7ae7579c8d37 tempest-VolumesTransfersTest-700081464 None] Created volume successfully. Sep 10 15:36:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-73394ce4-e9f1-482c-919e-a8a0225b52d9 tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8" returned: 0 in 0.632s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:37 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-73394ce4-e9f1-482c-919e-a8a0225b52d9 tempest-VolumesSnapshotListTestJSON-949421808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7dcf8871-a55c-4969-9eed-6a9ff820a240(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:36:37 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b66cae6-85d0-4fcb-b53a-8c68b61cd102]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:36:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-73394ce4-e9f1-482c-919e-a8a0225b52d9 tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-73394ce4-e9f1-482c-919e-a8a0225b52d9 tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8" returned: 0 in 0.606s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:38 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-73394ce4-e9f1-482c-919e-a8a0225b52d9 tempest-VolumesSnapshotListTestJSON-949421808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7dcf8871-a55c-4969-9eed-6a9ff820a240(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:36:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-73394ce4-e9f1-482c-919e-a8a0225b52d9 tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-73394ce4-e9f1-482c-919e-a8a0225b52d9 tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8" returned: 0 in 0.254s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-73394ce4-e9f1-482c-919e-a8a0225b52d9 tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-73394ce4-e9f1-482c-919e-a8a0225b52d9 tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8" returned: 0 in 0.136s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:39 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-73394ce4-e9f1-482c-919e-a8a0225b52d9 tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "cinder-quobyte-d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8" released by "_delete_snapshot" :: held 2.048s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:36:39 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-73394ce4-e9f1-482c-919e-a8a0225b52d9 tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "cinder-quobyte-7dcf8871-a55c-4969-9eed-6a9ff820a240" released by "delete_snapshot" :: held 2.148s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:36:39 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-73171dfd-ce9e-4705-a3eb-5fcf3f3fdcbc tempest-VolumesTransfersTest-239541903 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:36:39 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-73171dfd-ce9e-4705-a3eb-5fcf3f3fdcbc tempest-VolumesTransfersTest-239541903 None] Transfer volume completed successfully. Sep 10 15:36:39 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-73394ce4-e9f1-482c-919e-a8a0225b52d9 tempest-VolumesSnapshotListTestJSON-949421808 None] Created reservations ['ba77f766-8577-4cd8-9af8-6e3f40ed0537', '55d48eab-a669-4b73-b346-878baa479efd', '3bda3699-309f-49c2-afac-97f31803e459', '1a6f75fa-f1d0-45ff-a58e-96fefa004ed9'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:36:39 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-73394ce4-e9f1-482c-919e-a8a0225b52d9 tempest-VolumesSnapshotListTestJSON-949421808 None] Delete snapshot completed successfully. Sep 10 15:36:39 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-73394ce4-e9f1-482c-919e-a8a0225b52d9 tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "cinder-d009f9a1-b3f1-4ff1-a0ed-76e7a8f7c4d8-delete_snapshot" released by "delete_snapshot" :: held 3.004s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:36:40 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4167a2dd-9d8f-4aa2-bd29-c563b530957d tempest-VolumesTransfersTest-1229082895 None] Acquiring lock "cinder-6dd6fcba-854a-4df1-a874-e01c0869129d-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:36:40 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4167a2dd-9d8f-4aa2-bd29-c563b530957d tempest-VolumesTransfersTest-1229082895 None] Lock "cinder-6dd6fcba-854a-4df1-a874-e01c0869129d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:36:40 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-4167a2dd-9d8f-4aa2-bd29-c563b530957d tempest-VolumesTransfersTest-1229082895 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:36:40 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4167a2dd-9d8f-4aa2-bd29-c563b530957d tempest-VolumesTransfersTest-1229082895 None] Acquiring lock "cinder-quobyte-6dd6fcba-854a-4df1-a874-e01c0869129d" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:36:40 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4167a2dd-9d8f-4aa2-bd29-c563b530957d tempest-VolumesTransfersTest-1229082895 None] Lock "cinder-quobyte-6dd6fcba-854a-4df1-a874-e01c0869129d" acquired by "delete_volume" :: waited 0.015s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:36:40 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[1597c13e-6789-4962-8b36-7a3515d6218e]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:36:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4167a2dd-9d8f-4aa2-bd29-c563b530957d tempest-VolumesTransfersTest-1229082895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6dd6fcba-854a-4df1-a874-e01c0869129d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4c5a78f3-ccf6-4487-98c2-6ff43503b79a tempest-VolumesSnapshotListTestJSON-949421808 None] Acquiring lock "cinder-d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8-delete_snapshot" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:36:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4c5a78f3-ccf6-4487-98c2-6ff43503b79a tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "cinder-d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.124s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:36:41 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-4c5a78f3-ccf6-4487-98c2-6ff43503b79a tempest-VolumesSnapshotListTestJSON-949421808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:36:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4c5a78f3-ccf6-4487-98c2-6ff43503b79a tempest-VolumesSnapshotListTestJSON-949421808 None] Acquiring lock "cinder-quobyte-7dcf8871-a55c-4969-9eed-6a9ff820a240" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:36:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4c5a78f3-ccf6-4487-98c2-6ff43503b79a tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "cinder-quobyte-7dcf8871-a55c-4969-9eed-6a9ff820a240" acquired by "delete_snapshot" :: waited 0.034s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:36:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4c5a78f3-ccf6-4487-98c2-6ff43503b79a tempest-VolumesSnapshotListTestJSON-949421808 None] Acquiring lock "cinder-quobyte-d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8" by "_delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:36:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4167a2dd-9d8f-4aa2-bd29-c563b530957d tempest-VolumesTransfersTest-1229082895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6dd6fcba-854a-4df1-a874-e01c0869129d" returned: 0 in 0.653s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4167a2dd-9d8f-4aa2-bd29-c563b530957d tempest-VolumesTransfersTest-1229082895 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6dd6fcba-854a-4df1-a874-e01c0869129d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4167a2dd-9d8f-4aa2-bd29-c563b530957d tempest-VolumesTransfersTest-1229082895 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6dd6fcba-854a-4df1-a874-e01c0869129d" returned: 0 in 0.192s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4c5a78f3-ccf6-4487-98c2-6ff43503b79a tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "cinder-quobyte-d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8" acquired by "_delete_snapshot" :: waited 0.261s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:36:41 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-4c5a78f3-ccf6-4487-98c2-6ff43503b79a tempest-VolumesSnapshotListTestJSON-949421808 None] Deleting offline snapshot d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8 of volume 7dcf8871-a55c-4969-9eed-6a9ff820a240 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 15:36:41 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-4c5a78f3-ccf6-4487-98c2-6ff43503b79a tempest-VolumesSnapshotListTestJSON-949421808 None] snapshot_file for this snap is: volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 15:36:41 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efae743-c637-4e29-bc68-fc0c88b95267]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:36:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4c5a78f3-ccf6-4487-98c2-6ff43503b79a tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4167a2dd-9d8f-4aa2-bd29-c563b530957d tempest-VolumesTransfersTest-1229082895 None] Lock "cinder-quobyte-6dd6fcba-854a-4df1-a874-e01c0869129d" released by "delete_volume" :: held 1.242s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:36:42 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-4167a2dd-9d8f-4aa2-bd29-c563b530957d tempest-VolumesTransfersTest-1229082895 None] Created reservations ['e7f61609-1447-4dae-a3f1-4b52fd8eff4d', '7ba9a085-3cd4-454e-b79f-d4638206421d', 'b5db1f94-4f4a-425f-a417-2e84e80707c1', '19ac1e30-ad49-4ece-ace6-679f480f6bee'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:36:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-4167a2dd-9d8f-4aa2-bd29-c563b530957d tempest-VolumesTransfersTest-1229082895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:36:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-4167a2dd-9d8f-4aa2-bd29-c563b530957d tempest-VolumesTransfersTest-1229082895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:36:42 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-4167a2dd-9d8f-4aa2-bd29-c563b530957d tempest-VolumesTransfersTest-1229082895 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:36:42 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-4167a2dd-9d8f-4aa2-bd29-c563b530957d tempest-VolumesTransfersTest-1229082895 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:36:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-4167a2dd-9d8f-4aa2-bd29-c563b530957d tempest-VolumesTransfersTest-1229082895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:36:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4167a2dd-9d8f-4aa2-bd29-c563b530957d tempest-VolumesTransfersTest-1229082895 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:42 devstack quobyte-client[82814]: System call of process 92866 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:36:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4c5a78f3-ccf6-4487-98c2-6ff43503b79a tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8" returned: 0 in 1.182s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:42 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-4c5a78f3-ccf6-4487-98c2-6ff43503b79a tempest-VolumesSnapshotListTestJSON-949421808 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7dcf8871-a55c-4969-9eed-6a9ff820a240(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:36:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4167a2dd-9d8f-4aa2-bd29-c563b530957d tempest-VolumesTransfersTest-1229082895 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.276s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:42 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-4167a2dd-9d8f-4aa2-bd29-c563b530957d tempest-VolumesTransfersTest-1229082895 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:36:42 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16ecaf9-d7d8-43fb-b3ee-cf8eabcfcfcc]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:36:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4c5a78f3-ccf6-4487-98c2-6ff43503b79a tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:43 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-4167a2dd-9d8f-4aa2-bd29-c563b530957d tempest-VolumesTransfersTest-1229082895 None] Deleted volume successfully. Sep 10 15:36:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4c5a78f3-ccf6-4487-98c2-6ff43503b79a tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240" returned: 0 in 0.987s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4c5a78f3-ccf6-4487-98c2-6ff43503b79a tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:44 devstack quobyte-client[82814]: System call of process 92893 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:36:44 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4167a2dd-9d8f-4aa2-bd29-c563b530957d tempest-VolumesTransfersTest-1229082895 None] Lock "cinder-6dd6fcba-854a-4df1-a874-e01c0869129d-delete_volume" released by "delete_volume" :: held 3.983s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:36:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4c5a78f3-ccf6-4487-98c2-6ff43503b79a tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8" returned: 0 in 1.379s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4c5a78f3-ccf6-4487-98c2-6ff43503b79a tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:45 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:36:45 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:36:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Flow 'volume_create_manager' (56bb205a-194b-436c-a30b-f4fddddcb69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:36:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0caed8a-ff03-4add-b785-bd3563871bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:36:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0caed8a-ff03-4add-b785-bd3563871bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1907668921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1676fb10-9800-41b1-8eb3-51cfa644b40d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2bf284dba148e3841c835c2072ab59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:36:44Z,use_quota=True,user_id='11634f5ee7814c03a546ef396a38efc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:36:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3dd41a5-1d01-43e9-8cf3-3fcb73826d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:36:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3dd41a5-1d01-43e9-8cf3-3fcb73826d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:36:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a9a4ec-3739-47e8-a4be-1d9d01f8b732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:36:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a9a4ec-3739-47e8-a4be-1d9d01f8b732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1676fb10-9800-41b1-8eb3-51cfa644b40d', 'volume_name': 'volume-1676fb10-9800-41b1-8eb3-51cfa644b40d', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:36:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0faf80f0-8fbd-4ad7-817b-6936e22d8a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:36:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0faf80f0-8fbd-4ad7-817b-6936e22d8a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:36:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e58fbb-3ea1-49b2-8d4d-062658080903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:36:46 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Volume 1676fb10-9800-41b1-8eb3-51cfa644b40d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1676fb10-9800-41b1-8eb3-51cfa644b40d', 'volume_size': 1} Sep 10 15:36:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:36:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:36:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1907668921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1676fb10-9800-41b1-8eb3-51cfa644b40d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2bf284dba148e3841c835c2072ab59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:36:44Z,use_quota=True,user_id='11634f5ee7814c03a546ef396a38efc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:36:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Creating volume 1676fb10-9800-41b1-8eb3-51cfa644b40d {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:36:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:36:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:36:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:36:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:36:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:36:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:36:46 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:36:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1676fb10-9800-41b1-8eb3-51cfa644b40d 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4c5a78f3-ccf6-4487-98c2-6ff43503b79a tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240.d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8" returned: 0 in 1.041s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:46 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=80, name=volume-1676fb10-9800-41b1-8eb3-51cfa644b40d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:36:46 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4c5a78f3-ccf6-4487-98c2-6ff43503b79a tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "cinder-quobyte-d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8" released by "_delete_snapshot" :: held 5.199s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:36:46 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4c5a78f3-ccf6-4487-98c2-6ff43503b79a tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "cinder-quobyte-7dcf8871-a55c-4969-9eed-6a9ff820a240" released by "delete_snapshot" :: held 5.484s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:36:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1676fb10-9800-41b1-8eb3-51cfa644b40d 1073741824" returned: 0 in 0.628s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1676fb10-9800-41b1-8eb3-51cfa644b40d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1676fb10-9800-41b1-8eb3-51cfa644b40d" returned: 0 in 0.288s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:47 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] <== create_volume: return (965ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:36:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:36:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e58fbb-3ea1-49b2-8d4d-062658080903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1676fb10-9800-41b1-8eb3-51cfa644b40d', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:36:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c72b2511-6cae-44df-859d-132793c55269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:36:47 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Volume volume-1676fb10-9800-41b1-8eb3-51cfa644b40d (1676fb10-9800-41b1-8eb3-51cfa644b40d): created successfully Sep 10 15:36:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c72b2511-6cae-44df-859d-132793c55269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:36:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Flow 'volume_create_manager' (56bb205a-194b-436c-a30b-f4fddddcb69f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:36:47 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-7c365133-09c3-4809-a3c9-35bf74764af9 tempest-VolumesTransfersTest-700081464 None] Created volume successfully. Sep 10 15:36:47 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-4c5a78f3-ccf6-4487-98c2-6ff43503b79a tempest-VolumesSnapshotListTestJSON-949421808 None] Created reservations ['b79b108d-759b-44cd-acd5-b208f058f18c', 'de96b5e6-8e4c-4fc7-82df-8298fe453163', 'edd03a39-af8d-4057-b572-f1c7ae5020be', '9d155a75-3471-4872-8f4a-fe3b57aa67d0'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:36:47 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-4c5a78f3-ccf6-4487-98c2-6ff43503b79a tempest-VolumesSnapshotListTestJSON-949421808 None] Delete snapshot completed successfully. Sep 10 15:36:47 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4c5a78f3-ccf6-4487-98c2-6ff43503b79a tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "cinder-d4c024ec-e42c-45f6-bd90-e2ab7d4acdc8-delete_snapshot" released by "delete_snapshot" :: held 6.718s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:36:48 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c0ba3d7c-bc29-43a2-b855-c618ce663586 tempest-VolumesSnapshotListTestJSON-949421808 None] Acquiring lock "cinder-7dcf8871-a55c-4969-9eed-6a9ff820a240-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:36:48 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c0ba3d7c-bc29-43a2-b855-c618ce663586 tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "cinder-7dcf8871-a55c-4969-9eed-6a9ff820a240-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:36:49 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-c0ba3d7c-bc29-43a2-b855-c618ce663586 tempest-VolumesSnapshotListTestJSON-949421808 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:36:49 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c0ba3d7c-bc29-43a2-b855-c618ce663586 tempest-VolumesSnapshotListTestJSON-949421808 None] Acquiring lock "cinder-quobyte-7dcf8871-a55c-4969-9eed-6a9ff820a240" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:36:49 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c0ba3d7c-bc29-43a2-b855-c618ce663586 tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "cinder-quobyte-7dcf8871-a55c-4969-9eed-6a9ff820a240" acquired by "delete_volume" :: waited 0.015s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:36:49 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3168f1-0d5d-448e-b1ac-46a095de1e4f]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:36:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c0ba3d7c-bc29-43a2-b855-c618ce663586 tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:49 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a07efa71-5b2c-49dc-8316-a0b5450516dd tempest-VolumesTransfersTest-1229082895 None] Acquiring lock "cinder-1676fb10-9800-41b1-8eb3-51cfa644b40d-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:36:49 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a07efa71-5b2c-49dc-8316-a0b5450516dd tempest-VolumesTransfersTest-1229082895 None] Lock "cinder-1676fb10-9800-41b1-8eb3-51cfa644b40d-delete_volume" acquired by "delete_volume" :: waited 0.121s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:36:49 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-a07efa71-5b2c-49dc-8316-a0b5450516dd tempest-VolumesTransfersTest-1229082895 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:36:49 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a07efa71-5b2c-49dc-8316-a0b5450516dd tempest-VolumesTransfersTest-1229082895 None] Acquiring lock "cinder-quobyte-1676fb10-9800-41b1-8eb3-51cfa644b40d" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:36:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c0ba3d7c-bc29-43a2-b855-c618ce663586 tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240" returned: 0 in 0.798s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c0ba3d7c-bc29-43a2-b855-c618ce663586 tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c0ba3d7c-bc29-43a2-b855-c618ce663586 tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7dcf8871-a55c-4969-9eed-6a9ff820a240" returned: 0 in 0.214s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:50 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a07efa71-5b2c-49dc-8316-a0b5450516dd tempest-VolumesTransfersTest-1229082895 None] Lock "cinder-quobyte-1676fb10-9800-41b1-8eb3-51cfa644b40d" acquired by "delete_volume" :: waited 0.282s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:36:50 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c0ba3d7c-bc29-43a2-b855-c618ce663586 tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "cinder-quobyte-7dcf8871-a55c-4969-9eed-6a9ff820a240" released by "delete_volume" :: held 1.173s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:36:50 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[15babb2e-4875-45f9-a478-ee67c4729d7a]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:36:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a07efa71-5b2c-49dc-8316-a0b5450516dd tempest-VolumesTransfersTest-1229082895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1676fb10-9800-41b1-8eb3-51cfa644b40d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:50 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-c0ba3d7c-bc29-43a2-b855-c618ce663586 tempest-VolumesSnapshotListTestJSON-949421808 None] Created reservations ['69322820-76ca-4c4c-a542-094f75b1faee', '778ffa41-4ba8-4cba-8dc6-67f7512a1eed', '9e74c2c8-9165-4011-aae4-74ff3b0fea2c', 'e334487e-55a4-4d7b-8dc8-77143545831e'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:36:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a07efa71-5b2c-49dc-8316-a0b5450516dd tempest-VolumesTransfersTest-1229082895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1676fb10-9800-41b1-8eb3-51cfa644b40d" returned: 0 in 0.551s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a07efa71-5b2c-49dc-8316-a0b5450516dd tempest-VolumesTransfersTest-1229082895 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1676fb10-9800-41b1-8eb3-51cfa644b40d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a07efa71-5b2c-49dc-8316-a0b5450516dd tempest-VolumesTransfersTest-1229082895 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-1676fb10-9800-41b1-8eb3-51cfa644b40d" returned: 0 in 0.277s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:51 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a07efa71-5b2c-49dc-8316-a0b5450516dd tempest-VolumesTransfersTest-1229082895 None] Lock "cinder-quobyte-1676fb10-9800-41b1-8eb3-51cfa644b40d" released by "delete_volume" :: held 1.115s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:36:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c0ba3d7c-bc29-43a2-b855-c618ce663586 tempest-VolumesSnapshotListTestJSON-949421808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:36:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c0ba3d7c-bc29-43a2-b855-c618ce663586 tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:36:51 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c0ba3d7c-bc29-43a2-b855-c618ce663586 tempest-VolumesSnapshotListTestJSON-949421808 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:36:51 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c0ba3d7c-bc29-43a2-b855-c618ce663586 tempest-VolumesSnapshotListTestJSON-949421808 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:36:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c0ba3d7c-bc29-43a2-b855-c618ce663586 tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:36:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c0ba3d7c-bc29-43a2-b855-c618ce663586 tempest-VolumesSnapshotListTestJSON-949421808 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c0ba3d7c-bc29-43a2-b855-c618ce663586 tempest-VolumesSnapshotListTestJSON-949421808 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.181s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:51 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-c0ba3d7c-bc29-43a2-b855-c618ce663586 tempest-VolumesSnapshotListTestJSON-949421808 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:36:52 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-a07efa71-5b2c-49dc-8316-a0b5450516dd tempest-VolumesTransfersTest-1229082895 None] Created reservations ['2ae53db3-13e5-461e-8a87-d28f0d3d5104', '5c3de587-ae90-4f11-a0b0-0dbd2ade24a2', '0b8af3d6-6447-4b53-803f-16456e7602c4', 'e975a6cd-1583-4f23-a0f5-b5657f6e9ba0'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:36:52 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-c0ba3d7c-bc29-43a2-b855-c618ce663586 tempest-VolumesSnapshotListTestJSON-949421808 None] Deleted volume successfully. Sep 10 15:36:52 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c0ba3d7c-bc29-43a2-b855-c618ce663586 tempest-VolumesSnapshotListTestJSON-949421808 None] Lock "cinder-7dcf8871-a55c-4969-9eed-6a9ff820a240-delete_volume" released by "delete_volume" :: held 3.328s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:36:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a07efa71-5b2c-49dc-8316-a0b5450516dd tempest-VolumesTransfersTest-1229082895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:36:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a07efa71-5b2c-49dc-8316-a0b5450516dd tempest-VolumesTransfersTest-1229082895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:36:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a07efa71-5b2c-49dc-8316-a0b5450516dd tempest-VolumesTransfersTest-1229082895 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:36:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a07efa71-5b2c-49dc-8316-a0b5450516dd tempest-VolumesTransfersTest-1229082895 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:36:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a07efa71-5b2c-49dc-8316-a0b5450516dd tempest-VolumesTransfersTest-1229082895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:36:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a07efa71-5b2c-49dc-8316-a0b5450516dd tempest-VolumesTransfersTest-1229082895 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:36:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a07efa71-5b2c-49dc-8316-a0b5450516dd tempest-VolumesTransfersTest-1229082895 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.121s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:36:52 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-a07efa71-5b2c-49dc-8316-a0b5450516dd tempest-VolumesTransfersTest-1229082895 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:36:52 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-a07efa71-5b2c-49dc-8316-a0b5450516dd tempest-VolumesTransfersTest-1229082895 None] Deleted volume successfully. Sep 10 15:36:52 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a07efa71-5b2c-49dc-8316-a0b5450516dd tempest-VolumesTransfersTest-1229082895 None] Lock "cinder-1676fb10-9800-41b1-8eb3-51cfa644b40d-delete_volume" released by "delete_volume" :: held 3.124s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:37:06 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:37:06 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:37:06 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Flow 'volume_create_manager' (0da663ef-aa72-49c7-86f0-7eeccc58efa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:37:06 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4328d5ed-4d72-4610-9d29-a1b209df469a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:06 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4328d5ed-4d72-4610-9d29-a1b209df469a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1661114468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57d0873-fce2-4413-abe1-1b0aa97869e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cd000e029d4462c9d48c2eb88972948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:37:06Z,use_quota=True,user_id='c2514887f68941b98c8a9bd66a220286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:06 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f42332a-c61b-4f3e-a023-55552b81e344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:06 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f42332a-c61b-4f3e-a023-55552b81e344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:06 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5fa6604-b009-43a0-8cdf-2d036071ed4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:06 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5fa6604-b009-43a0-8cdf-2d036071ed4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c57d0873-fce2-4413-abe1-1b0aa97869e7', 'volume_name': 'volume-c57d0873-fce2-4413-abe1-1b0aa97869e7', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:06 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04715a1-3097-42f6-8328-04b8db1c1153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:06 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04715a1-3097-42f6-8328-04b8db1c1153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:06 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99f37ae9-3d5f-4d60-98ad-7bcbba97721f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:06 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Volume c57d0873-fce2-4413-abe1-1b0aa97869e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c57d0873-fce2-4413-abe1-1b0aa97869e7', 'volume_size': 1} Sep 10 15:37:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:37:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:37:06 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1661114468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57d0873-fce2-4413-abe1-1b0aa97869e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cd000e029d4462c9d48c2eb88972948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:37:06Z,use_quota=True,user_id='c2514887f68941b98c8a9bd66a220286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:37:06 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Creating volume c57d0873-fce2-4413-abe1-1b0aa97869e7 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:37:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:37:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:37:06 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:37:06 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:37:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:37:06 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:37:06 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:37:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c57d0873-fce2-4413-abe1-1b0aa97869e7 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:37:06 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=81, name=volume-c57d0873-fce2-4413-abe1-1b0aa97869e7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:37:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c57d0873-fce2-4413-abe1-1b0aa97869e7 1073741824" returned: 0 in 0.573s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:37:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c57d0873-fce2-4413-abe1-1b0aa97869e7 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:37:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c57d0873-fce2-4413-abe1-1b0aa97869e7" returned: 0 in 0.396s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:37:07 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] <== create_volume: return (1150ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:37:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:37:07 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99f37ae9-3d5f-4d60-98ad-7bcbba97721f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c57d0873-fce2-4413-abe1-1b0aa97869e7', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:07 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad184f6-b139-410d-a052-3e81d03086f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:07 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Volume volume-c57d0873-fce2-4413-abe1-1b0aa97869e7 (c57d0873-fce2-4413-abe1-1b0aa97869e7): created successfully Sep 10 15:37:07 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad184f6-b139-410d-a052-3e81d03086f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:07 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Flow 'volume_create_manager' (0da663ef-aa72-49c7-86f0-7eeccc58efa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:37:07 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-7fbdd079-d6bf-41b8-a7b0-ab84908a162b tempest-VolumesTransfersV357Test-949092729 None] Created volume successfully. Sep 10 15:37:09 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-961d31ab-0919-4713-91e9-18fe6abcb2f4 tempest-VolumesTransfersV357Test-426721517 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:37:09 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-961d31ab-0919-4713-91e9-18fe6abcb2f4 tempest-VolumesTransfersV357Test-426721517 None] Transfer volume completed successfully. Sep 10 15:37:10 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-148f1fb1-3f84-411d-80bf-140f1e861ef3 tempest-VolumesTransfersV357Test-1095335525 None] Acquiring lock "cinder-c57d0873-fce2-4413-abe1-1b0aa97869e7-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:37:11 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-148f1fb1-3f84-411d-80bf-140f1e861ef3 tempest-VolumesTransfersV357Test-1095335525 None] Lock "cinder-c57d0873-fce2-4413-abe1-1b0aa97869e7-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:37:11 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-148f1fb1-3f84-411d-80bf-140f1e861ef3 tempest-VolumesTransfersV357Test-1095335525 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:37:11 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-148f1fb1-3f84-411d-80bf-140f1e861ef3 tempest-VolumesTransfersV357Test-1095335525 None] Acquiring lock "cinder-quobyte-c57d0873-fce2-4413-abe1-1b0aa97869e7" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:37:11 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-148f1fb1-3f84-411d-80bf-140f1e861ef3 tempest-VolumesTransfersV357Test-1095335525 None] Lock "cinder-quobyte-c57d0873-fce2-4413-abe1-1b0aa97869e7" acquired by "delete_volume" :: waited 0.015s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:37:11 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91709e0-9ee0-4a3a-a293-a02cba5d1efa]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:37:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-148f1fb1-3f84-411d-80bf-140f1e861ef3 tempest-VolumesTransfersV357Test-1095335525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c57d0873-fce2-4413-abe1-1b0aa97869e7 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:37:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-148f1fb1-3f84-411d-80bf-140f1e861ef3 tempest-VolumesTransfersV357Test-1095335525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c57d0873-fce2-4413-abe1-1b0aa97869e7" returned: 0 in 0.566s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:37:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-148f1fb1-3f84-411d-80bf-140f1e861ef3 tempest-VolumesTransfersV357Test-1095335525 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c57d0873-fce2-4413-abe1-1b0aa97869e7 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:37:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-148f1fb1-3f84-411d-80bf-140f1e861ef3 tempest-VolumesTransfersV357Test-1095335525 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c57d0873-fce2-4413-abe1-1b0aa97869e7" returned: 0 in 0.126s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:37:12 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-148f1fb1-3f84-411d-80bf-140f1e861ef3 tempest-VolumesTransfersV357Test-1095335525 None] Lock "cinder-quobyte-c57d0873-fce2-4413-abe1-1b0aa97869e7" released by "delete_volume" :: held 0.930s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:37:12 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-148f1fb1-3f84-411d-80bf-140f1e861ef3 tempest-VolumesTransfersV357Test-1095335525 None] Created reservations ['f4ec1f9a-d8d3-40d3-96d3-9d6969290cff', '20a8535e-7c37-4321-8284-7d5896d70b9e', '7947293c-b9ed-4814-ade0-b87ccf2d44d2', 'edabb192-12dd-450b-aa23-8b5aaae7edd3'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:37:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-148f1fb1-3f84-411d-80bf-140f1e861ef3 tempest-VolumesTransfersV357Test-1095335525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:37:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-148f1fb1-3f84-411d-80bf-140f1e861ef3 tempest-VolumesTransfersV357Test-1095335525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:37:12 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-148f1fb1-3f84-411d-80bf-140f1e861ef3 tempest-VolumesTransfersV357Test-1095335525 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:37:12 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-148f1fb1-3f84-411d-80bf-140f1e861ef3 tempest-VolumesTransfersV357Test-1095335525 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:37:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-148f1fb1-3f84-411d-80bf-140f1e861ef3 tempest-VolumesTransfersV357Test-1095335525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:37:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-148f1fb1-3f84-411d-80bf-140f1e861ef3 tempest-VolumesTransfersV357Test-1095335525 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:37:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-148f1fb1-3f84-411d-80bf-140f1e861ef3 tempest-VolumesTransfersV357Test-1095335525 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.144s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:37:12 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-148f1fb1-3f84-411d-80bf-140f1e861ef3 tempest-VolumesTransfersV357Test-1095335525 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:37:12 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-148f1fb1-3f84-411d-80bf-140f1e861ef3 tempest-VolumesTransfersV357Test-1095335525 None] Deleted volume successfully. Sep 10 15:37:13 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-148f1fb1-3f84-411d-80bf-140f1e861ef3 tempest-VolumesTransfersV357Test-1095335525 None] Lock "cinder-c57d0873-fce2-4413-abe1-1b0aa97869e7-delete_volume" released by "delete_volume" :: held 2.796s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:37:14 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:37:14 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:37:14 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Flow 'volume_create_manager' (94e5a5d7-1503-463f-89b9-77c4ae3a51e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:37:14 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dbeb97e-98d7-48df-bcc3-57c8dfc44827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:14 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dbeb97e-98d7-48df-bcc3-57c8dfc44827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1270563214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=567574d1-af42-4ed9-a035-56e29b955fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cd000e029d4462c9d48c2eb88972948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:37:14Z,use_quota=True,user_id='c2514887f68941b98c8a9bd66a220286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:14 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d07ced-7f55-4fab-a8ae-17cfbd82c180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:14 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d07ced-7f55-4fab-a8ae-17cfbd82c180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:14 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ccbc831-fdbd-4df5-832c-f96a0e57e0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:14 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ccbc831-fdbd-4df5-832c-f96a0e57e0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '567574d1-af42-4ed9-a035-56e29b955fce', 'volume_name': 'volume-567574d1-af42-4ed9-a035-56e29b955fce', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:14 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45da850-c5aa-4a39-93c1-52a4764a0f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:14 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45da850-c5aa-4a39-93c1-52a4764a0f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:14 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c96b66-4851-4387-8a4f-c82d52193873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:14 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Volume 567574d1-af42-4ed9-a035-56e29b955fce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-567574d1-af42-4ed9-a035-56e29b955fce', 'volume_size': 1} Sep 10 15:37:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:37:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:37:14 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1270563214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=567574d1-af42-4ed9-a035-56e29b955fce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cd000e029d4462c9d48c2eb88972948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:37:14Z,use_quota=True,user_id='c2514887f68941b98c8a9bd66a220286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:37:14 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Creating volume 567574d1-af42-4ed9-a035-56e29b955fce {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:37:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:37:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:37:14 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:37:14 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:37:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:37:14 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:37:14 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:37:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-567574d1-af42-4ed9-a035-56e29b955fce 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:37:14 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=82, name=volume-567574d1-af42-4ed9-a035-56e29b955fce, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:37:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-567574d1-af42-4ed9-a035-56e29b955fce 1073741824" returned: 0 in 0.517s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:37:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-567574d1-af42-4ed9-a035-56e29b955fce {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:37:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-567574d1-af42-4ed9-a035-56e29b955fce" returned: 0 in 0.155s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:37:15 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] <== create_volume: return (800ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:37:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:37:15 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c96b66-4851-4387-8a4f-c82d52193873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-567574d1-af42-4ed9-a035-56e29b955fce', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:15 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d185d93b-be12-44fa-95fd-9f2e5c4c2131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:15 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Volume volume-567574d1-af42-4ed9-a035-56e29b955fce (567574d1-af42-4ed9-a035-56e29b955fce): created successfully Sep 10 15:37:15 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d185d93b-be12-44fa-95fd-9f2e5c4c2131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:15 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Flow 'volume_create_manager' (94e5a5d7-1503-463f-89b9-77c4ae3a51e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:37:15 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-01c97de3-7d23-4af2-be51-963811f4ab78 tempest-VolumesTransfersV357Test-949092729 None] Created volume successfully. Sep 10 15:37:17 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4ee756c4-7c09-4476-bc38-c5bd10673f70 tempest-VolumesTransfersV357Test-1095335525 None] Acquiring lock "cinder-567574d1-af42-4ed9-a035-56e29b955fce-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:37:17 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4ee756c4-7c09-4476-bc38-c5bd10673f70 tempest-VolumesTransfersV357Test-1095335525 None] Lock "cinder-567574d1-af42-4ed9-a035-56e29b955fce-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:37:17 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=59,cinder:DELETE=8,cinder:UPDATE=69,cinder:INSERT=24 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:37:17 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=83,cinder:DELETE=6,cinder:SELECT=50,cinder:INSERT=12 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:37:17 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-4ee756c4-7c09-4476-bc38-c5bd10673f70 tempest-VolumesTransfersV357Test-1095335525 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:37:17 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4ee756c4-7c09-4476-bc38-c5bd10673f70 tempest-VolumesTransfersV357Test-1095335525 None] Acquiring lock "cinder-quobyte-567574d1-af42-4ed9-a035-56e29b955fce" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:37:17 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4ee756c4-7c09-4476-bc38-c5bd10673f70 tempest-VolumesTransfersV357Test-1095335525 None] Lock "cinder-quobyte-567574d1-af42-4ed9-a035-56e29b955fce" acquired by "delete_volume" :: waited 0.018s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:37:17 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ba0ce6-901a-43c9-a646-a8e26d1101bc]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:37:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4ee756c4-7c09-4476-bc38-c5bd10673f70 tempest-VolumesTransfersV357Test-1095335525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-567574d1-af42-4ed9-a035-56e29b955fce {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:37:18 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-d74e1fe7-3e18-4476-b881-619fad1dde93 req-917f1253-c3fc-4aaa-bcb8-46e01708f80b tempest-AttachVolumeNegativeTest-150614502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:37:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4ee756c4-7c09-4476-bc38-c5bd10673f70 tempest-VolumesTransfersV357Test-1095335525 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-567574d1-af42-4ed9-a035-56e29b955fce" returned: 0 in 1.231s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:37:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4ee756c4-7c09-4476-bc38-c5bd10673f70 tempest-VolumesTransfersV357Test-1095335525 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-567574d1-af42-4ed9-a035-56e29b955fce {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:37:18 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-d74e1fe7-3e18-4476-b881-619fad1dde93 req-917f1253-c3fc-4aaa-bcb8-46e01708f80b tempest-AttachVolumeNegativeTest-150614502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:37:18 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-d74e1fe7-3e18-4476-b881-619fad1dde93 req-917f1253-c3fc-4aaa-bcb8-46e01708f80b tempest-AttachVolumeNegativeTest-150614502 None] Terminate volume connection completed successfully. Sep 10 15:37:18 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-d74e1fe7-3e18-4476-b881-619fad1dde93 req-917f1253-c3fc-4aaa-bcb8-46e01708f80b tempest-AttachVolumeNegativeTest-150614502 None] Deleting attachment ba52f966-8e67-447e-a34c-b0535ee7c4c6. {{(pid=82800) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 15:37:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4ee756c4-7c09-4476-bc38-c5bd10673f70 tempest-VolumesTransfersV357Test-1095335525 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-567574d1-af42-4ed9-a035-56e29b955fce" returned: 0 in 0.238s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:37:19 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4ee756c4-7c09-4476-bc38-c5bd10673f70 tempest-VolumesTransfersV357Test-1095335525 None] Lock "cinder-quobyte-567574d1-af42-4ed9-a035-56e29b955fce" released by "delete_volume" :: held 1.612s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:37:19 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-4ee756c4-7c09-4476-bc38-c5bd10673f70 tempest-VolumesTransfersV357Test-1095335525 None] Created reservations ['7d936724-b7b8-4bc3-a2bd-b22f4059c3dd', '5b62646e-ebeb-4738-afc3-e122f2eb2eb2', 'fc257ed8-b57b-4294-875b-873ce5ad885e', '9532dc7d-fc56-458d-b62a-4eb268c5412c'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:37:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-4ee756c4-7c09-4476-bc38-c5bd10673f70 tempest-VolumesTransfersV357Test-1095335525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:37:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-4ee756c4-7c09-4476-bc38-c5bd10673f70 tempest-VolumesTransfersV357Test-1095335525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:37:19 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-4ee756c4-7c09-4476-bc38-c5bd10673f70 tempest-VolumesTransfersV357Test-1095335525 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:37:19 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-4ee756c4-7c09-4476-bc38-c5bd10673f70 tempest-VolumesTransfersV357Test-1095335525 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:37:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-4ee756c4-7c09-4476-bc38-c5bd10673f70 tempest-VolumesTransfersV357Test-1095335525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:37:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4ee756c4-7c09-4476-bc38-c5bd10673f70 tempest-VolumesTransfersV357Test-1095335525 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:37:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4ee756c4-7c09-4476-bc38-c5bd10673f70 tempest-VolumesTransfersV357Test-1095335525 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.221s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:37:20 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-4ee756c4-7c09-4476-bc38-c5bd10673f70 tempest-VolumesTransfersV357Test-1095335525 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:37:20 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-4ee756c4-7c09-4476-bc38-c5bd10673f70 tempest-VolumesTransfersV357Test-1095335525 None] Deleted volume successfully. Sep 10 15:37:20 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-4ee756c4-7c09-4476-bc38-c5bd10673f70 tempest-VolumesTransfersV357Test-1095335525 None] Lock "cinder-567574d1-af42-4ed9-a035-56e29b955fce-delete_volume" released by "delete_volume" :: held 3.039s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:37:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:37:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:37:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:37:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:37:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:37:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:37:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:37:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.153s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:37:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:37:29 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=4,cinder:INSERT=3,cinder:UPDATE=4 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:37:30 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:37:45 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:37:45 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:37:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Flow 'volume_create_manager' (95a02770-25e6-46ac-b8d9-69148b2a1cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:37:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34965fdc-d120-490d-948b-91dc22921bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34965fdc-d120-490d-948b-91dc22921bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-648304376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b3da968-3239-4878-9f95-9049e6567187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa03826c0d524a2a9cfc2b54cef2e148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:37:45Z,use_quota=True,user_id='d8864e2605fc45d9895b93e64abca43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b698a645-226b-4989-a346-1931c15da553),volume_type_id=b698a645-226b-4989-a346-1931c15da553)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad7a67a5-e83e-4549-8e65-924cb9eb910b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad7a67a5-e83e-4549-8e65-924cb9eb910b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f072397e-81c1-4469-9ff9-d2ae27ff0731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f072397e-81c1-4469-9ff9-d2ae27ff0731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b3da968-3239-4878-9f95-9049e6567187', 'volume_name': 'volume-4b3da968-3239-4878-9f95-9049e6567187', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c4cbba7-ac40-413d-a644-ca836a25602f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c4cbba7-ac40-413d-a644-ca836a25602f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4909a56b-4611-45dd-98ba-805c50bfd6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:46 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Volume 4b3da968-3239-4878-9f95-9049e6567187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b3da968-3239-4878-9f95-9049e6567187', 'volume_size': 1} Sep 10 15:37:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:37:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:37:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-648304376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b3da968-3239-4878-9f95-9049e6567187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa03826c0d524a2a9cfc2b54cef2e148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:37:45Z,use_quota=True,user_id='d8864e2605fc45d9895b93e64abca43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b698a645-226b-4989-a346-1931c15da553),volume_type_id=b698a645-226b-4989-a346-1931c15da553)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:37:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Creating volume 4b3da968-3239-4878-9f95-9049e6567187 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:37:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:37:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:37:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:37:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:37:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:37:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:37:46 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:37:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b3da968-3239-4878-9f95-9049e6567187 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:37:46 devstack quobyte-client[82814]: System call of process 93063 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:37:46 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=83, name=volume-4b3da968-3239-4878-9f95-9049e6567187, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:37:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b3da968-3239-4878-9f95-9049e6567187 1073741824" returned: 0 in 0.843s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:37:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b3da968-3239-4878-9f95-9049e6567187 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:37:47 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:37:47 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:37:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Flow 'volume_create_manager' (1d71b81c-6539-456e-8bc6-3fbb1cbccb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:37:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d14f94-cac2-4bbe-be44-46789f4505d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48d14f94-cac2-4bbe-be44-46789f4505d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1456341985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=535bb65a-c71f-4d55-b2f3-dd9b2ad61945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa03826c0d524a2a9cfc2b54cef2e148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:37:46Z,use_quota=True,user_id='d8864e2605fc45d9895b93e64abca43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd34083a-d468-426c-bd4f-4ac9abae279b),volume_type_id=bd34083a-d468-426c-bd4f-4ac9abae279b)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d5b3bd3-9819-4347-b381-22391bc5336c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d5b3bd3-9819-4347-b381-22391bc5336c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09cb5e18-b5a1-435b-aa3f-fc823d1b7291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09cb5e18-b5a1-435b-aa3f-fc823d1b7291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '535bb65a-c71f-4d55-b2f3-dd9b2ad61945', 'volume_name': 'volume-535bb65a-c71f-4d55-b2f3-dd9b2ad61945', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01d29e9-0d72-46e4-b8cb-31f71286a8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01d29e9-0d72-46e4-b8cb-31f71286a8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:48 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ae381a-2639-469d-9140-1cad5fc3d638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:48 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Volume 535bb65a-c71f-4d55-b2f3-dd9b2ad61945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-535bb65a-c71f-4d55-b2f3-dd9b2ad61945', 'volume_size': 1} Sep 10 15:37:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:37:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b3da968-3239-4878-9f95-9049e6567187" returned: 0 in 0.849s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:37:48 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] <== create_volume: return (1740ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:37:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:37:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.090s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:37:48 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1456341985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=535bb65a-c71f-4d55-b2f3-dd9b2ad61945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa03826c0d524a2a9cfc2b54cef2e148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:37:46Z,use_quota=True,user_id='d8864e2605fc45d9895b93e64abca43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd34083a-d468-426c-bd4f-4ac9abae279b),volume_type_id=bd34083a-d468-426c-bd4f-4ac9abae279b)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:37:48 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Creating volume 535bb65a-c71f-4d55-b2f3-dd9b2ad61945 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:37:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:37:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:37:48 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:37:48 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:37:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:37:48 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:37:48 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:37:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-535bb65a-c71f-4d55-b2f3-dd9b2ad61945 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:37:48 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=84, name=volume-535bb65a-c71f-4d55-b2f3-dd9b2ad61945, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:37:48 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4909a56b-4611-45dd-98ba-805c50bfd6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b3da968-3239-4878-9f95-9049e6567187', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:48 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2991925d-9466-4919-a815-4b5ad0fd4ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:48 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Volume volume-4b3da968-3239-4878-9f95-9049e6567187 (4b3da968-3239-4878-9f95-9049e6567187): created successfully Sep 10 15:37:48 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2991925d-9466-4919-a815-4b5ad0fd4ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:48 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Flow 'volume_create_manager' (95a02770-25e6-46ac-b8d9-69148b2a1cea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:37:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-535bb65a-c71f-4d55-b2f3-dd9b2ad61945 1073741824" returned: 0 in 0.800s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:37:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-535bb65a-c71f-4d55-b2f3-dd9b2ad61945 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:37:49 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-51a553b2-3493-47f8-8711-ad54c9d57de0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Created volume successfully. Sep 10 15:37:49 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:37:49 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:37:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Flow 'volume_create_manager' (59c87209-7654-4b14-b8ef-668196f4f83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:37:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (617361bd-4ee8-42b5-b7e2-af1daa11bf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-535bb65a-c71f-4d55-b2f3-dd9b2ad61945" returned: 0 in 0.765s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:37:49 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] <== create_volume: return (1603ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:37:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:37:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (617361bd-4ee8-42b5-b7e2-af1daa11bf84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1424735144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f79c729-a710-4707-acc7-92deb2b009ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa03826c0d524a2a9cfc2b54cef2e148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:37:48Z,use_quota=True,user_id='d8864e2605fc45d9895b93e64abca43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22e96491-4d25-47ee-845d-15606046fe49),volume_type_id=22e96491-4d25-47ee-845d-15606046fe49)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5807227-1f8c-4f45-992d-aeddc0450a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5807227-1f8c-4f45-992d-aeddc0450a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4fb2890-a982-45bf-9aaa-eea1c712d243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ae381a-2639-469d-9140-1cad5fc3d638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-535bb65a-c71f-4d55-b2f3-dd9b2ad61945', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62cbf68a-4e50-4f76-bc3b-51ed009119d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:49 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Volume volume-535bb65a-c71f-4d55-b2f3-dd9b2ad61945 (535bb65a-c71f-4d55-b2f3-dd9b2ad61945): created successfully Sep 10 15:37:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62cbf68a-4e50-4f76-bc3b-51ed009119d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Flow 'volume_create_manager' (1d71b81c-6539-456e-8bc6-3fbb1cbccb74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:37:50 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-31c4b0fb-94fa-468c-a0a5-cfcf852f4473 tempest-TestInstancesWithCinderVolumes-2005022567 None] Created volume successfully. Sep 10 15:37:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4fb2890-a982-45bf-9aaa-eea1c712d243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8f79c729-a710-4707-acc7-92deb2b009ab', 'volume_name': 'volume-8f79c729-a710-4707-acc7-92deb2b009ab', 'volume_size': 1, 'image_id': '72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--408393300', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa03826c0d524a2a9cfc2b54cef2e148', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc', 'created_at': datetime.datetime(2025, 9, 10, 13, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 13, 37, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc/file', 'properties': {}}, 'image_service': }' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4cce54-95ec-47d9-bcb7-85ee575183bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba4cce54-95ec-47d9-bcb7-85ee575183bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a0c5cf-ee7f-441e-87f7-8b1e4b0e643c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:50 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Volume 8f79c729-a710-4707-acc7-92deb2b009ab: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8f79c729-a710-4707-acc7-92deb2b009ab', 'volume_size': 1, 'image_id': '72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--408393300', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa03826c0d524a2a9cfc2b54cef2e148', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc', 'created_at': datetime.datetime(2025, 9, 10, 13, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 13, 37, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc/file', 'properties': {}}, 'image_service': } Sep 10 15:37:50 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Cloning 8f79c729-a710-4707-acc7-92deb2b009ab from image 72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc at location (None, None). {{(pid=82800) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 15:37:54 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc_q526_u4cdevstack@QuobyteHD, size 20.69 MB, duration 3.85 sec {{(pid=82800) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 15:37:54 devstack cinder-volume[82800]: INFO cinder.image.image_utils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Image download 20.69 MB at 5.37 MB/s Sep 10 15:37:54 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0fe4fa-daf1-471f-855e-d93cb75e0534]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:37:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc_q526_u4cdevstack@QuobyteHD {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:37:55 devstack sudo[93089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc_q526_u4cdevstack@QuobyteHD Sep 10 15:37:55 devstack sudo[93089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:37:57 devstack sudo[93089]: pam_unix(sudo:session): session closed for user root Sep 10 15:37:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc_q526_u4cdevstack@QuobyteHD" returned: 0 in 3.116s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:37:57 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Temporary image 72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc is fetched for user d8864e2605fc45d9895b93e64abca43d. {{(pid=82800) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 15:37:57 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ccd061-393e-477d-9244-294b20e8aa14]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:37:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc_q526_u4cdevstack@QuobyteHD {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:37:58 devstack sudo[93096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc_q526_u4cdevstack@QuobyteHD Sep 10 15:37:58 devstack sudo[93096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:37:58 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:37:58 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:37:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Flow 'volume_create_manager' (9eab162c-9c9d-4bf6-8158-4b8ddeffbe90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:37:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0396eed7-9be2-4641-9d5d-3db0e898c4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0396eed7-9be2-4641-9d5d-3db0e898c4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-132171445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30780bd63a1546d086869b8730c7d0d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:37:58Z,use_quota=True,user_id='4b78a75fd50b4e028f6dec6b305af467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fda6317-653b-4370-b081-e3a1f9eef08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fda6317-653b-4370-b081-e3a1f9eef08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b39ec7-71bc-4dc3-9756-773d81a72abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b39ec7-71bc-4dc3-9756-773d81a72abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4', 'volume_name': 'volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca8bd8e-9b35-4ac8-8c86-1cc57f33b609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca8bd8e-9b35-4ac8-8c86-1cc57f33b609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:37:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4842346f-33d2-42a6-880a-3b351e094a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:37:58 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Volume 27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4', 'volume_size': 1} Sep 10 15:37:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:37:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:37:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-132171445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30780bd63a1546d086869b8730c7d0d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:37:58Z,use_quota=True,user_id='4b78a75fd50b4e028f6dec6b305af467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:37:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Creating volume 27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:37:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:37:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:37:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:37:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:37:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:37:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:37:58 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:37:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:37:59 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=85, name=volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:37:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4 1073741824" returned: 0 in 0.491s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:37:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:37:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4" returned: 0 in 0.177s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:37:59 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] <== create_volume: return (766ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:37:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:38:00 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4842346f-33d2-42a6-880a-3b351e094a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:38:00 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2c8e992-a71e-4a10-a202-d2eda861c3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:38:00 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Volume volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4 (27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4): created successfully Sep 10 15:38:00 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2c8e992-a71e-4a10-a202-d2eda861c3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:38:00 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Flow 'volume_create_manager' (9eab162c-9c9d-4bf6-8158-4b8ddeffbe90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:38:00 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-f2f60215-431c-4880-a756-37bfde439dbc tempest-VolumesActionsTest-96955990 None] Created volume successfully. Sep 10 15:38:00 devstack sudo[93096]: pam_unix(sudo:session): session closed for user root Sep 10 15:38:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc_q526_u4cdevstack@QuobyteHD" returned: 0 in 3.105s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:38:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:38:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:38:00 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1424735144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f79c729-a710-4707-acc7-92deb2b009ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa03826c0d524a2a9cfc2b54cef2e148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:37:48Z,use_quota=True,user_id='d8864e2605fc45d9895b93e64abca43d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22e96491-4d25-47ee-845d-15606046fe49),volume_type_id=22e96491-4d25-47ee-845d-15606046fe49)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:38:00 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Creating volume 8f79c729-a710-4707-acc7-92deb2b009ab {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:38:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:38:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:38:00 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:38:00 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:38:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:38:00 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:38:00 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:38:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8f79c729-a710-4707-acc7-92deb2b009ab 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:38:01 devstack quobyte-client[82814]: System call of process 93112 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:38:01 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=86, name=volume-8f79c729-a710-4707-acc7-92deb2b009ab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:38:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8f79c729-a710-4707-acc7-92deb2b009ab 1073741824" returned: 0 in 0.631s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:38:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8f79c729-a710-4707-acc7-92deb2b009ab {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:38:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8f79c729-a710-4707-acc7-92deb2b009ab" returned: 0 in 0.125s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:38:01 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] <== create_volume: return (891ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:38:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:38:02 devstack cinder-volume[82800]: DEBUG cinder.volume.volume_utils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Attempting download of 72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc ((None, None)) to volume 8f79c729-a710-4707-acc7-92deb2b009ab. {{(pid=82800) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 15:38:02 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[243be6df-4505-44dc-ab5c-7c73aa87cfc5]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:38:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc_siso6b9z {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:38:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc_siso6b9z" returned: 0 in 0.591s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:38:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc_siso6b9z {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:38:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc_siso6b9z" returned: 1 in 1.140s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:38:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc_siso6b9z' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:38:04 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f23577-d409-4734-8af7-eaeb0ca9a4ed]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:38:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc_q526_u4cdevstack@QuobyteHD {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:38:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc_q526_u4cdevstack@QuobyteHD" returned: 0 in 1.605s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:38:06 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] 72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc was qcow2, converting to raw {{(pid=82800) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 15:38:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc_q526_u4cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8f79c729-a710-4707-acc7-92deb2b009ab {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:38:06 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=86, name=volume-8f79c729-a710-4707-acc7-92deb2b009ab, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:38:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc_q526_u4cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8f79c729-a710-4707-acc7-92deb2b009ab" returned: 0 in 2.416s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:38:08 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc_q526_u4cdevstack@QuobyteHD, size 112.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8f79c729-a710-4707-acc7-92deb2b009ab {{(pid=82800) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 15:38:08 devstack cinder-volume[82800]: INFO cinder.image.image_utils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Converted 112.00 MB image at 44.35 MB/s Sep 10 15:38:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8f79c729-a710-4707-acc7-92deb2b009ab 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:38:09 devstack quobyte-client[82814]: System call of process 93203 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:38:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8f79c729-a710-4707-acc7-92deb2b009ab 1G" returned: 0 in 0.536s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:38:09 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[30171bbd-20cc-4302-8995-06a9398a664e]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:38:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8f79c729-a710-4707-acc7-92deb2b009ab {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:38:10 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5,cinder:DELETE=1,cinder:INSERT=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:38:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8f79c729-a710-4707-acc7-92deb2b009ab" returned: 0 in 1.122s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:38:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8f79c729-a710-4707-acc7-92deb2b009ab {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:38:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8f79c729-a710-4707-acc7-92deb2b009ab" returned: 1 in 0.834s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:38:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8f79c729-a710-4707-acc7-92deb2b009ab' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:38:11 devstack cinder-volume[82800]: DEBUG cinder.volume.volume_utils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Downloaded image 72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc ((None, None)) to volume 8f79c729-a710-4707-acc7-92deb2b009ab successfully. {{(pid=82800) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 15:38:11 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Temporary image 72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc for user d8864e2605fc45d9895b93e64abca43d is deleted. {{(pid=82800) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 15:38:11 devstack cinder-volume[82800]: DEBUG cinder.volume.volume_utils [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Marking volume 8f79c729-a710-4707-acc7-92deb2b009ab as bootable. {{(pid=82800) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 15:38:12 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=10,cinder:SELECT=4,cinder:DELETE=2 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:38:12 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Copying metadata from image 72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc to 8f79c729-a710-4707-acc7-92deb2b009ab. {{(pid=82800) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 15:38:12 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Creating volume glance metadata for volume 8f79c729-a710-4707-acc7-92deb2b009ab backed by image 72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc with: {'image_id': '72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc', 'image_name': 'tempest-scenario-img--408393300', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82800) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 15:38:14 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a0c5cf-ee7f-441e-87f7-8b1e4b0e643c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f79c729-a710-4707-acc7-92deb2b009ab', 'volume_size': 1, 'image_id': '72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc', 'image_location': (None, None), 'image_meta': {'name': 'tempest-scenario-img--408393300', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fa03826c0d524a2a9cfc2b54cef2e148', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc', 'created_at': datetime.datetime(2025, 9, 10, 13, 37, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 13, 37, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72fac9d1-b851-4b9c-8e3d-0d92b3f3f7dc/file', 'properties': {}}, 'image_service': }' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:38:14 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a688cc6-6a3f-4334-8c4f-214496b971b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:38:14 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Volume volume-8f79c729-a710-4707-acc7-92deb2b009ab (8f79c729-a710-4707-acc7-92deb2b009ab): created successfully Sep 10 15:38:14 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a688cc6-6a3f-4334-8c4f-214496b971b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:38:14 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Flow 'volume_create_manager' (59c87209-7654-4b14-b8ef-668196f4f83f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:38:14 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-62e30876-612e-458e-b1ab-77bebe1e5dfc tempest-TestInstancesWithCinderVolumes-2005022567 None] Created volume successfully. Sep 10 15:38:24 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=4,cinder:INSERT=5,cinder:UPDATE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:38:24 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=3,cinder:SELECT=5,cinder:INSERT=3,cinder:DELETE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:38:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:38:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:38:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.028s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:38:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:38:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:38:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.118s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:38:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:38:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.730s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:38:30 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:38:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-5b419c28-8597-4242-892c-1008d60b88ea req-8fd72919-fad5-4295-9ef0-e60b2609f908 tempest-TestInstancesWithCinderVolumes-2005022567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:38:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-5b419c28-8597-4242-892c-1008d60b88ea req-8fd72919-fad5-4295-9ef0-e60b2609f908 tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:38:37 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8f44bc-b03f-49ae-a3b7-0b20e055ddfe]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:38:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-5b419c28-8597-4242-892c-1008d60b88ea req-8fd72919-fad5-4295-9ef0-e60b2609f908 tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8f79c729-a710-4707-acc7-92deb2b009ab {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:38:39 devstack quobyte-client[82814]: System call of process 93363 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:38:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-5b419c28-8597-4242-892c-1008d60b88ea req-8fd72919-fad5-4295-9ef0-e60b2609f908 tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8f79c729-a710-4707-acc7-92deb2b009ab" returned: 0 in 1.423s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:38:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-5b419c28-8597-4242-892c-1008d60b88ea req-8fd72919-fad5-4295-9ef0-e60b2609f908 tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8f79c729-a710-4707-acc7-92deb2b009ab {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:38:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-12c4519d-baf2-45e3-bb6c-d3b28d630edd tempest-VolumesActionsTest-96955990 None] Acquiring lock "cinder-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4" by "attach_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:38:41 devstack quobyte-client[82814]: System call of process 93369 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:38:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-5b419c28-8597-4242-892c-1008d60b88ea req-8fd72919-fad5-4295-9ef0-e60b2609f908 tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8f79c729-a710-4707-acc7-92deb2b009ab" returned: 1 in 2.254s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:38:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-5b419c28-8597-4242-892c-1008d60b88ea req-8fd72919-fad5-4295-9ef0-e60b2609f908 tempest-TestInstancesWithCinderVolumes-2005022567 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8f79c729-a710-4707-acc7-92deb2b009ab' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:38:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-5b419c28-8597-4242-892c-1008d60b88ea req-8fd72919-fad5-4295-9ef0-e60b2609f908 tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 4.129s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:38:42 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-12c4519d-baf2-45e3-bb6c-d3b28d630edd tempest-VolumesActionsTest-96955990 None] Lock "cinder-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4" acquired by "attach_volume" :: waited 0.823s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:38:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-5b419c28-8597-4242-892c-1008d60b88ea req-8fd72919-fad5-4295-9ef0-e60b2609f908 tempest-TestInstancesWithCinderVolumes-2005022567 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5', 'name': 'volume-8f79c729-a710-4707-acc7-92deb2b009ab', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67fe440a-f814-41fb-ad97-7112de885099', 'enforce_multipath': True} {{(pid=82800) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 15:38:42 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-5b419c28-8597-4242-892c-1008d60b88ea req-8fd72919-fad5-4295-9ef0-e60b2609f908 tempest-TestInstancesWithCinderVolumes-2005022567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:38:42 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-12c4519d-baf2-45e3-bb6c-d3b28d630edd tempest-VolumesActionsTest-96955990 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:38:42 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-12c4519d-baf2-45e3-bb6c-d3b28d630edd tempest-VolumesActionsTest-96955990 None] Attaching volume 27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4 to instance 9fa75010-e487-4e15-8014-3d1dedbd8a04 at mountpoint /dev/vdb on host None. Sep 10 15:38:42 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-12c4519d-baf2-45e3-bb6c-d3b28d630edd tempest-VolumesActionsTest-96955990 None] Attach volume completed successfully. Sep 10 15:38:42 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-5b419c28-8597-4242-892c-1008d60b88ea req-8fd72919-fad5-4295-9ef0-e60b2609f908 tempest-TestInstancesWithCinderVolumes-2005022567 None] attachment_update completed successfully. Sep 10 15:38:42 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-12c4519d-baf2-45e3-bb6c-d3b28d630edd tempest-VolumesActionsTest-96955990 None] Lock "cinder-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4" released by "attach_volume" :: held 0.594s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:38:43 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ddb34f36-d043-40db-8286-644b03358f63 tempest-VolumesActionsTest-96955990 None] Acquiring lock "cinder-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4-detach_volume" by "detach_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:38:43 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ddb34f36-d043-40db-8286-644b03358f63 tempest-VolumesActionsTest-96955990 None] Lock "cinder-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:38:43 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-ddb34f36-d043-40db-8286-644b03358f63 tempest-VolumesActionsTest-96955990 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:38:43 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-ddb34f36-d043-40db-8286-644b03358f63 tempest-VolumesActionsTest-96955990 None] Detaching volume 27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4 from instance 9fa75010-e487-4e15-8014-3d1dedbd8a04. Sep 10 15:38:43 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-ddb34f36-d043-40db-8286-644b03358f63 tempest-VolumesActionsTest-96955990 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:38:43 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-ddb34f36-d043-40db-8286-644b03358f63 tempest-VolumesActionsTest-96955990 None] Detach volume completed successfully. Sep 10 15:38:43 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ddb34f36-d043-40db-8286-644b03358f63 tempest-VolumesActionsTest-96955990 None] Lock "cinder-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4-detach_volume" released by "detach_volume" :: held 0.207s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:38:53 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=10,cinder:UPDATE=4 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:38:53 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=14,cinder:INSERT=2,cinder:UPDATE=5 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:39:07 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:39:07 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:39:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:39:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:39:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:39:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:39:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:39:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.212s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:39:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:39:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 1.594s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:39:31 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:39:33 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:39:33 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:39:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Flow 'volume_create_manager' (9acb8035-55e2-4e6e-99a2-6c5c9cbcd96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:39:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4990d89b-a631-4383-9121-1333c57c0b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:39:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4990d89b-a631-4383-9121-1333c57c0b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1381140558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24cd94a-7068-4d6d-b69b-fb03aa025f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9d906d00c7646979fa02dbfdd95ae5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:39:32Z,use_quota=True,user_id='14d1a6101d8b4633a6790929f16d6b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:39:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110aaedc-32fe-4bb7-8056-d16ffd168594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:39:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110aaedc-32fe-4bb7-8056-d16ffd168594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:39:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfacf40-ee81-4576-94f2-b8e5e43028d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:39:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfacf40-ee81-4576-94f2-b8e5e43028d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd24cd94a-7068-4d6d-b69b-fb03aa025f6a', 'volume_name': 'volume-d24cd94a-7068-4d6d-b69b-fb03aa025f6a', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:39:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c776fca-3374-49e9-98d8-57c172fa26c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:39:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c776fca-3374-49e9-98d8-57c172fa26c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:39:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41bd1e12-a235-4818-9b65-77b80e351718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:39:34 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Volume d24cd94a-7068-4d6d-b69b-fb03aa025f6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d24cd94a-7068-4d6d-b69b-fb03aa025f6a', 'volume_size': 1} Sep 10 15:39:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:39:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:39:34 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1381140558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24cd94a-7068-4d6d-b69b-fb03aa025f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9d906d00c7646979fa02dbfdd95ae5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:39:32Z,use_quota=True,user_id='14d1a6101d8b4633a6790929f16d6b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:39:34 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Creating volume d24cd94a-7068-4d6d-b69b-fb03aa025f6a {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:39:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:39:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:39:34 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:39:34 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:39:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:39:34 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:39:34 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:39:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-d24cd94a-7068-4d6d-b69b-fb03aa025f6a 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:39:35 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=87, name=volume-d24cd94a-7068-4d6d-b69b-fb03aa025f6a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:39:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-d24cd94a-7068-4d6d-b69b-fb03aa025f6a 1073741824" returned: 0 in 1.218s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:39:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-d24cd94a-7068-4d6d-b69b-fb03aa025f6a {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:39:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-d24cd94a-7068-4d6d-b69b-fb03aa025f6a" returned: 0 in 0.306s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:39:36 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] <== create_volume: return (1722ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:39:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:39:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41bd1e12-a235-4818-9b65-77b80e351718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d24cd94a-7068-4d6d-b69b-fb03aa025f6a', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:39:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f1813d4-e79e-4577-9a23-57eec3d1822e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:39:37 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Volume volume-d24cd94a-7068-4d6d-b69b-fb03aa025f6a (d24cd94a-7068-4d6d-b69b-fb03aa025f6a): created successfully Sep 10 15:39:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f1813d4-e79e-4577-9a23-57eec3d1822e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:39:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Flow 'volume_create_manager' (9acb8035-55e2-4e6e-99a2-6c5c9cbcd96f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:39:37 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-25085a27-ff5d-4003-9475-a389c96e6a3c tempest-AttachVolumeNegativeTest-150614502 None] Created volume successfully. Sep 10 15:39:42 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-f30cca58-672b-40f5-875d-8022e9a1ced9 tempest-VolumesActionsTest-96955990 None] Acquiring lock "cinder-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4" by "attach_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:39:42 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-f30cca58-672b-40f5-875d-8022e9a1ced9 tempest-VolumesActionsTest-96955990 None] Lock "cinder-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4" acquired by "attach_volume" :: waited 0.106s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:39:42 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-f30cca58-672b-40f5-875d-8022e9a1ced9 tempest-VolumesActionsTest-96955990 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:39:42 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-f30cca58-672b-40f5-875d-8022e9a1ced9 tempest-VolumesActionsTest-96955990 None] Attaching volume 27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4 to instance d260fd10-a350-41f1-9246-b65c14bc684a at mountpoint /dev/vdb on host None. Sep 10 15:39:43 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-f30cca58-672b-40f5-875d-8022e9a1ced9 tempest-VolumesActionsTest-96955990 None] Attach volume completed successfully. Sep 10 15:39:43 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-f30cca58-672b-40f5-875d-8022e9a1ced9 tempest-VolumesActionsTest-96955990 None] Lock "cinder-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4" released by "attach_volume" :: held 0.469s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:39:43 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-3e83179f-6930-4959-b2a3-993ea43abef5 tempest-VolumesActionsTest-96955990 None] Acquiring lock "cinder-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4-detach_volume" by "detach_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:39:43 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-3e83179f-6930-4959-b2a3-993ea43abef5 tempest-VolumesActionsTest-96955990 None] Lock "cinder-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:39:43 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-3e83179f-6930-4959-b2a3-993ea43abef5 tempest-VolumesActionsTest-96955990 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:39:43 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-3e83179f-6930-4959-b2a3-993ea43abef5 tempest-VolumesActionsTest-96955990 None] Detaching volume 27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4 from instance d260fd10-a350-41f1-9246-b65c14bc684a. Sep 10 15:39:43 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-3e83179f-6930-4959-b2a3-993ea43abef5 tempest-VolumesActionsTest-96955990 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:39:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-0aa16b3b-f2c2-4859-ac0c-a6053007866e req-854645ab-c41e-4142-a739-e51d9e1784e8 tempest-AttachVolumeNegativeTest-150614502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:39:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-0aa16b3b-f2c2-4859-ac0c-a6053007866e req-854645ab-c41e-4142-a739-e51d9e1784e8 tempest-AttachVolumeNegativeTest-150614502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:39:43 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-3e83179f-6930-4959-b2a3-993ea43abef5 tempest-VolumesActionsTest-96955990 None] Detach volume completed successfully. Sep 10 15:39:43 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-3e83179f-6930-4959-b2a3-993ea43abef5 tempest-VolumesActionsTest-96955990 None] Lock "cinder-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4-detach_volume" released by "detach_volume" :: held 0.137s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:39:43 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c24bd3-b5bc-4ad6-9808-4a417037529a]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:39:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-0aa16b3b-f2c2-4859-ac0c-a6053007866e req-854645ab-c41e-4142-a739-e51d9e1784e8 tempest-AttachVolumeNegativeTest-150614502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-d24cd94a-7068-4d6d-b69b-fb03aa025f6a {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:39:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-0aa16b3b-f2c2-4859-ac0c-a6053007866e req-854645ab-c41e-4142-a739-e51d9e1784e8 tempest-AttachVolumeNegativeTest-150614502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-d24cd94a-7068-4d6d-b69b-fb03aa025f6a" returned: 0 in 1.024s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:39:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-0aa16b3b-f2c2-4859-ac0c-a6053007866e req-854645ab-c41e-4142-a739-e51d9e1784e8 tempest-AttachVolumeNegativeTest-150614502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.098s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:39:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-0aa16b3b-f2c2-4859-ac0c-a6053007866e req-854645ab-c41e-4142-a739-e51d9e1784e8 tempest-AttachVolumeNegativeTest-150614502 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5', 'name': 'volume-d24cd94a-7068-4d6d-b69b-fb03aa025f6a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '978a6256-4f56-419e-8fda-e304ac8bf12e', 'enforce_multipath': True} {{(pid=82800) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 15:39:45 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-0aa16b3b-f2c2-4859-ac0c-a6053007866e req-854645ab-c41e-4142-a739-e51d9e1784e8 tempest-AttachVolumeNegativeTest-150614502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:39:45 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-0aa16b3b-f2c2-4859-ac0c-a6053007866e req-854645ab-c41e-4142-a739-e51d9e1784e8 tempest-AttachVolumeNegativeTest-150614502 None] attachment_update completed successfully. Sep 10 15:39:55 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=8,cinder:SELECT=9,cinder:DELETE=1,cinder:INSERT=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:39:55 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=17,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:39:59 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-e239a0b0-23cc-4908-ab5d-463918300810 tempest-VolumesActionsTest-96955990 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:39:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e239a0b0-23cc-4908-ab5d-463918300810 tempest-VolumesActionsTest-96955990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:39:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e239a0b0-23cc-4908-ab5d-463918300810 tempest-VolumesActionsTest-96955990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:39:59 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[92776f1c-51ec-49b6-a1e5-e611fe9032e3]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:39:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e239a0b0-23cc-4908-ab5d-463918300810 tempest-VolumesActionsTest-96955990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:39:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e239a0b0-23cc-4908-ab5d-463918300810 tempest-VolumesActionsTest-96955990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4" returned: 0 in 0.405s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:39:59 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[2826b086-0992-420b-ba3e-69c2e4d2d00d]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:39:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e239a0b0-23cc-4908-ab5d-463918300810 tempest-VolumesActionsTest-96955990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:40:00 devstack quobyte-client[82814]: System call of process 94248 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:40:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e239a0b0-23cc-4908-ab5d-463918300810 tempest-VolumesActionsTest-96955990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4" returned: 0 in 0.481s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:40:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e239a0b0-23cc-4908-ab5d-463918300810 tempest-VolumesActionsTest-96955990 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4 /opt/stack/data/cinder/conversion/27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4.temp_image.96c3a265-5ae4-4edb-a37a-1fc392ac808aew1adcgq.img {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:40:09 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:40:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e239a0b0-23cc-4908-ab5d-463918300810 tempest-VolumesActionsTest-96955990 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4 /opt/stack/data/cinder/conversion/27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4.temp_image.96c3a265-5ae4-4edb-a37a-1fc392ac808aew1adcgq.img" returned: 0 in 9.817s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:40:10 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[e018fe8d-d52b-4987-be64-b9d53cf39ccb]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:40:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e239a0b0-23cc-4908-ab5d-463918300810 tempest-VolumesActionsTest-96955990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:40:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e239a0b0-23cc-4908-ab5d-463918300810 tempest-VolumesActionsTest-96955990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4" returned: 0 in 1.002s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:40:11 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-e239a0b0-23cc-4908-ab5d-463918300810 tempest-VolumesActionsTest-96955990 None] Image conversion details: src /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4, size 1024.00 MB, duration 9.83 sec, destination /opt/stack/data/cinder/conversion/27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4.temp_image.96c3a265-5ae4-4edb-a37a-1fc392ac808aew1adcgq.img {{(pid=82800) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 15:40:11 devstack cinder-volume[82800]: INFO cinder.image.image_utils [None req-e239a0b0-23cc-4908-ab5d-463918300810 tempest-VolumesActionsTest-96955990 None] Converted 1024.00 MB image at 104.22 MB/s Sep 10 15:40:11 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-e239a0b0-23cc-4908-ab5d-463918300810 tempest-VolumesActionsTest-96955990 None] 96c3a265-5ae4-4edb-a37a-1fc392ac808a was raw, no need to convert to raw {{(pid=82800) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}} Sep 10 15:40:17 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-a3135403-6a4e-4fde-a7c3-fa3c47ae23d8 req-6a65a9c3-d09f-4ebf-a676-61537bf98ac3 tempest-AttachVolumeNegativeTest-150614502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:40:17 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-a3135403-6a4e-4fde-a7c3-fa3c47ae23d8 req-6a65a9c3-d09f-4ebf-a676-61537bf98ac3 tempest-AttachVolumeNegativeTest-150614502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:40:17 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-a3135403-6a4e-4fde-a7c3-fa3c47ae23d8 req-6a65a9c3-d09f-4ebf-a676-61537bf98ac3 tempest-AttachVolumeNegativeTest-150614502 None] Terminate volume connection completed successfully. Sep 10 15:40:17 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-a3135403-6a4e-4fde-a7c3-fa3c47ae23d8 req-6a65a9c3-d09f-4ebf-a676-61537bf98ac3 tempest-AttachVolumeNegativeTest-150614502 None] Deleting attachment 978a6256-4f56-419e-8fda-e304ac8bf12e. {{(pid=82800) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 15:40:21 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=2 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:40:27 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=2 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:40:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:40:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:40:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:40:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:40:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:40:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:40:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:40:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.283s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:40:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:40:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-63d799cd-2f5a-46e6-bdd3-d4816485c849 req-877ace8e-0d7f-4fb8-af03-961d78954402 tempest-TestInstancesWithCinderVolumes-2005022567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:40:46 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:40:46 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:41:08 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:41:08 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:41:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e239a0b0-23cc-4908-ab5d-463918300810 tempest-VolumesActionsTest-96955990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 77.527s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:41:17 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e239a0b0-23cc-4908-ab5d-463918300810 tempest-VolumesActionsTest-96955990 None] Uploaded volume to glance image-id: 96c3a265-5ae4-4edb-a37a-1fc392ac808a. {{(pid=82800) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 10 15:41:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-63d799cd-2f5a-46e6-bdd3-d4816485c849 req-877ace8e-0d7f-4fb8-af03-961d78954402 tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 40.758s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:41:17 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-e239a0b0-23cc-4908-ab5d-463918300810 tempest-VolumesActionsTest-96955990 None] Copy volume to image completed successfully. Sep 10 15:41:17 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5bda47-6df5-45b7-a801-88e55f57781a]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:41:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-63d799cd-2f5a-46e6-bdd3-d4816485c849 req-877ace8e-0d7f-4fb8-af03-961d78954402 tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b3da968-3239-4878-9f95-9049e6567187 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:41:19 devstack quobyte-client[82814]: System call of process 94528 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:41:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-63d799cd-2f5a-46e6-bdd3-d4816485c849 req-877ace8e-0d7f-4fb8-af03-961d78954402 tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b3da968-3239-4878-9f95-9049e6567187" returned: 0 in 1.945s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:41:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-63d799cd-2f5a-46e6-bdd3-d4816485c849 req-877ace8e-0d7f-4fb8-af03-961d78954402 tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.187s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:41:20 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-63d799cd-2f5a-46e6-bdd3-d4816485c849 req-877ace8e-0d7f-4fb8-af03-961d78954402 tempest-TestInstancesWithCinderVolumes-2005022567 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5', 'name': 'volume-4b3da968-3239-4878-9f95-9049e6567187', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '939b5a96-260b-40fd-961e-fe270420ebec', 'enforce_multipath': True} {{(pid=82800) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 15:41:20 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-63d799cd-2f5a-46e6-bdd3-d4816485c849 req-877ace8e-0d7f-4fb8-af03-961d78954402 tempest-TestInstancesWithCinderVolumes-2005022567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:41:20 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-63d799cd-2f5a-46e6-bdd3-d4816485c849 req-877ace8e-0d7f-4fb8-af03-961d78954402 tempest-TestInstancesWithCinderVolumes-2005022567 None] attachment_update completed successfully. Sep 10 15:41:23 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:41:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:41:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:41:23 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[29503dff-a04e-4379-8421-d4af23bbd9ad]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:41:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:41:24 devstack quobyte-client[82814]: System call of process 94546 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:41:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4" returned: 0 in 1.240s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:41:25 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[541bc92e-c2fd-41dd-a5a0-35da5aa36e35]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:41:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:41:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4" returned: 0 in 0.662s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:41:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4 /opt/stack/data/cinder/conversion/27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4.temp_image.ff208aa1-f19f-4db8-b3cd-f9345239d845hglj87q0.img {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:41:26 devstack quobyte-client[82814]: System call of process 94553 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:41:30 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:41:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:41:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.093s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:41:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:41:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:41:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.353s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:41:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:41:30 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:41:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.701s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:41:31 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:41:33 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:41:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4 /opt/stack/data/cinder/conversion/27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4.temp_image.ff208aa1-f19f-4db8-b3cd-f9345239d845hglj87q0.img" returned: 0 in 13.033s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:41:38 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[519df8e6-8846-4fbb-920f-4ee1073f0ae9]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:41:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:41:39 devstack quobyte-client[82814]: System call of process 94614 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:41:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-2cac2825-a28a-4529-b9cb-08c0b8eceb4a req-287cb11a-1e11-4422-b877-954c15c9a4c0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:41:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4" returned: 0 in 1.198s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:41:40 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] Image conversion details: src /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4, size 1024.00 MB, duration 13.05 sec, destination /opt/stack/data/cinder/conversion/27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4.temp_image.ff208aa1-f19f-4db8-b3cd-f9345239d845hglj87q0.img {{(pid=82800) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 15:41:40 devstack cinder-volume[82800]: INFO cinder.image.image_utils [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] Converted 1024.00 MB image at 78.50 MB/s Sep 10 15:41:40 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] ff208aa1-f19f-4db8-b3cd-f9345239d845 was raw, converting to qcow2 {{(pid=82800) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}} Sep 10 15:41:40 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e55d9f7-6b7a-41c7-bd75-a60a30d3c13b]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:41:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4.temp_image.ff208aa1-f19f-4db8-b3cd-f9345239d845hglj87q0.img {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:41:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4.temp_image.ff208aa1-f19f-4db8-b3cd-f9345239d845hglj87q0.img" returned: 0 in 0.601s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:41:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4.temp_image.ff208aa1-f19f-4db8-b3cd-f9345239d845hglj87q0.img {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:41:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4.temp_image.ff208aa1-f19f-4db8-b3cd-f9345239d845hglj87q0.img" returned: 1 in 0.703s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:41:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4.temp_image.ff208aa1-f19f-4db8-b3cd-f9345239d845hglj87q0.img' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:41:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4.temp_image.ff208aa1-f19f-4db8-b3cd-f9345239d845hglj87q0.img /opt/stack/data/cinder/conversion/vol_upload_8b6y1u8l {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:41:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4.temp_image.ff208aa1-f19f-4db8-b3cd-f9345239d845hglj87q0.img /opt/stack/data/cinder/conversion/vol_upload_8b6y1u8l" returned: 0 in 0.241s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:41:41 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] Image conversion details: src /opt/stack/data/cinder/conversion/27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4.temp_image.ff208aa1-f19f-4db8-b3cd-f9345239d845hglj87q0.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_8b6y1u8l {{(pid=82800) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 15:41:41 devstack cinder-volume[82800]: INFO cinder.image.image_utils [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 10 15:41:41 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c0a4d7-1093-40c8-ae3f-ea62990384be]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:41:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8b6y1u8l {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:41:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8b6y1u8l" returned: 0 in 0.540s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:41:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 21.788s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:41:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] Uploaded volume to glance image-id: ff208aa1-f19f-4db8-b3cd-f9345239d845. {{(pid=82800) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 10 15:41:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-2cac2825-a28a-4529-b9cb-08c0b8eceb4a req-287cb11a-1e11-4422-b877-954c15c9a4c0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.727s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:41:45 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[185ed7fe-1719-4a86-8d5b-25ad70246b1c]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:41:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-2cac2825-a28a-4529-b9cb-08c0b8eceb4a req-287cb11a-1e11-4422-b877-954c15c9a4c0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-535bb65a-c71f-4d55-b2f3-dd9b2ad61945 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:41:45 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-8ae402f8-e717-41b9-aaa1-193a56767845 tempest-VolumesActionsTest-96955990 None] Copy volume to image completed successfully. Sep 10 15:41:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-2cac2825-a28a-4529-b9cb-08c0b8eceb4a req-287cb11a-1e11-4422-b877-954c15c9a4c0 tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-535bb65a-c71f-4d55-b2f3-dd9b2ad61945" returned: 0 in 0.628s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:41:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-2cac2825-a28a-4529-b9cb-08c0b8eceb4a req-287cb11a-1e11-4422-b877-954c15c9a4c0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.773s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:41:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-2cac2825-a28a-4529-b9cb-08c0b8eceb4a req-287cb11a-1e11-4422-b877-954c15c9a4c0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5', 'name': 'volume-535bb65a-c71f-4d55-b2f3-dd9b2ad61945', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ea13f1d-6b5b-4288-a048-a9d992ed6512', 'enforce_multipath': True} {{(pid=82800) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 15:41:46 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-2cac2825-a28a-4529-b9cb-08c0b8eceb4a req-287cb11a-1e11-4422-b877-954c15c9a4c0 tempest-TestInstancesWithCinderVolumes-2005022567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:41:46 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-2cac2825-a28a-4529-b9cb-08c0b8eceb4a req-287cb11a-1e11-4422-b877-954c15c9a4c0 tempest-TestInstancesWithCinderVolumes-2005022567 None] attachment_update completed successfully. Sep 10 15:41:48 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ffd83dac-2ce2-4b83-9379-1238a6d121ec tempest-VolumesActionsTest-96955990 None] Acquiring lock "cinder-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:41:48 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ffd83dac-2ce2-4b83-9379-1238a6d121ec tempest-VolumesActionsTest-96955990 None] Lock "cinder-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:41:48 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-ffd83dac-2ce2-4b83-9379-1238a6d121ec tempest-VolumesActionsTest-96955990 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:41:48 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ffd83dac-2ce2-4b83-9379-1238a6d121ec tempest-VolumesActionsTest-96955990 None] Acquiring lock "cinder-quobyte-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:41:48 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ffd83dac-2ce2-4b83-9379-1238a6d121ec tempest-VolumesActionsTest-96955990 None] Lock "cinder-quobyte-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4" acquired by "delete_volume" :: waited 0.037s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:41:48 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d2f88a-4cbd-4436-b70e-84e7f0ecfbb2]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:41:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ffd83dac-2ce2-4b83-9379-1238a6d121ec tempest-VolumesActionsTest-96955990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:41:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ffd83dac-2ce2-4b83-9379-1238a6d121ec tempest-VolumesActionsTest-96955990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4" returned: 0 in 0.769s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:41:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ffd83dac-2ce2-4b83-9379-1238a6d121ec tempest-VolumesActionsTest-96955990 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:41:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ffd83dac-2ce2-4b83-9379-1238a6d121ec tempest-VolumesActionsTest-96955990 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4" returned: 0 in 0.191s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:41:49 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ffd83dac-2ce2-4b83-9379-1238a6d121ec tempest-VolumesActionsTest-96955990 None] Lock "cinder-quobyte-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4" released by "delete_volume" :: held 1.141s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:41:50 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-ffd83dac-2ce2-4b83-9379-1238a6d121ec tempest-VolumesActionsTest-96955990 None] Created reservations ['52cec5fd-e3c3-492f-a6f2-4832a96d81c1', '8ad15408-e132-4b42-81af-07c5bb05ab7d', '747e8a68-ba2c-471d-90f6-b82b8781b175', 'bbd575d9-1750-4e54-bcc2-b88087b4a949'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:41:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ffd83dac-2ce2-4b83-9379-1238a6d121ec tempest-VolumesActionsTest-96955990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:41:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ffd83dac-2ce2-4b83-9379-1238a6d121ec tempest-VolumesActionsTest-96955990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:41:50 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-ffd83dac-2ce2-4b83-9379-1238a6d121ec tempest-VolumesActionsTest-96955990 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:41:50 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-ffd83dac-2ce2-4b83-9379-1238a6d121ec tempest-VolumesActionsTest-96955990 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:41:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ffd83dac-2ce2-4b83-9379-1238a6d121ec tempest-VolumesActionsTest-96955990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:41:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ffd83dac-2ce2-4b83-9379-1238a6d121ec tempest-VolumesActionsTest-96955990 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:41:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ffd83dac-2ce2-4b83-9379-1238a6d121ec tempest-VolumesActionsTest-96955990 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.165s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:41:51 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-ffd83dac-2ce2-4b83-9379-1238a6d121ec tempest-VolumesActionsTest-96955990 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:41:51 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-ffd83dac-2ce2-4b83-9379-1238a6d121ec tempest-VolumesActionsTest-96955990 None] Deleted volume successfully. Sep 10 15:41:51 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ffd83dac-2ce2-4b83-9379-1238a6d121ec tempest-VolumesActionsTest-96955990 None] Lock "cinder-27dc8dc8-202b-4d8a-ab91-6d2eabd7fff4-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:42:00 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=14,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:42:01 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=10,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:42:02 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:42:02 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:42:02 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Flow 'volume_create_manager' (e304c6ca-9e7b-45a9-81fb-1a6f31038236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:42:02 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e53fb8-4635-4c63-93fd-b688ac1fa028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:42:02 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e53fb8-4635-4c63-93fd-b688ac1fa028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-465501732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdb16c1-c2c9-472a-b4a9-6bcc5efd1984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48a21d51a2f4db6aed81ad382fb0d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:42:02Z,use_quota=True,user_id='d124cc15124c4792be7ec1929a851d7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:42:02 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa0374a-1ec7-438a-9c2c-9521c884f501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:42:02 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa0374a-1ec7-438a-9c2c-9521c884f501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:42:02 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f708520-69b7-4c6a-8c93-0cecdcd815c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:42:02 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f708520-69b7-4c6a-8c93-0cecdcd815c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcdb16c1-c2c9-472a-b4a9-6bcc5efd1984', 'volume_name': 'volume-bcdb16c1-c2c9-472a-b4a9-6bcc5efd1984', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:42:02 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e4f0ca-af22-4220-ad38-6821998e1fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:42:02 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e4f0ca-af22-4220-ad38-6821998e1fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:42:02 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (836af4ce-cc0f-4ca2-92c3-e9dc49c8841e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:42:02 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Volume bcdb16c1-c2c9-472a-b4a9-6bcc5efd1984: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcdb16c1-c2c9-472a-b4a9-6bcc5efd1984', 'volume_size': 1} Sep 10 15:42:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:42:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:42:02 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-465501732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdb16c1-c2c9-472a-b4a9-6bcc5efd1984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48a21d51a2f4db6aed81ad382fb0d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:42:02Z,use_quota=True,user_id='d124cc15124c4792be7ec1929a851d7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:42:02 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Creating volume bcdb16c1-c2c9-472a-b4a9-6bcc5efd1984 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:42:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:42:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:42:02 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:42:02 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:42:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:42:02 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:42:02 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:42:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bcdb16c1-c2c9-472a-b4a9-6bcc5efd1984 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:42:02 devstack quobyte-client[82814]: System call of process 94707 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:42:02 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=88, name=volume-bcdb16c1-c2c9-472a-b4a9-6bcc5efd1984, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:42:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bcdb16c1-c2c9-472a-b4a9-6bcc5efd1984 1073741824" returned: 0 in 0.500s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:42:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bcdb16c1-c2c9-472a-b4a9-6bcc5efd1984 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:42:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bcdb16c1-c2c9-472a-b4a9-6bcc5efd1984" returned: 0 in 0.105s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:42:03 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] <== create_volume: return (682ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:42:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:42:03 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (836af4ce-cc0f-4ca2-92c3-e9dc49c8841e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcdb16c1-c2c9-472a-b4a9-6bcc5efd1984', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:42:03 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe03015-429b-4d56-a02a-92bc950b4679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:42:03 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Volume volume-bcdb16c1-c2c9-472a-b4a9-6bcc5efd1984 (bcdb16c1-c2c9-472a-b4a9-6bcc5efd1984): created successfully Sep 10 15:42:03 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe03015-429b-4d56-a02a-92bc950b4679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:42:03 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Flow 'volume_create_manager' (e304c6ca-9e7b-45a9-81fb-1a6f31038236) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:42:03 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-f7c09c96-8752-47dc-978c-8a27ec45243e tempest-VolumesNegativeTest-1397623248 None] Created volume successfully. Sep 10 15:42:13 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=2 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:42:13 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:42:25 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-ed6c96cc-94ba-42da-bd0b-1653ce13fd03 req-7e7ab92d-f77e-4527-8e2a-42d1023d5374 tempest-TestInstancesWithCinderVolumes-2005022567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:42:25 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-ed6c96cc-94ba-42da-bd0b-1653ce13fd03 req-7e7ab92d-f77e-4527-8e2a-42d1023d5374 tempest-TestInstancesWithCinderVolumes-2005022567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:42:25 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-ed6c96cc-94ba-42da-bd0b-1653ce13fd03 req-7e7ab92d-f77e-4527-8e2a-42d1023d5374 tempest-TestInstancesWithCinderVolumes-2005022567 None] Terminate volume connection completed successfully. Sep 10 15:42:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-ed6c96cc-94ba-42da-bd0b-1653ce13fd03 req-7e7ab92d-f77e-4527-8e2a-42d1023d5374 tempest-TestInstancesWithCinderVolumes-2005022567 None] Deleting attachment 939b5a96-260b-40fd-961e-fe270420ebec. {{(pid=82800) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 15:42:28 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fde7a3ec-b57a-4bda-9f3b-29ecb75bf218 tempest-TestInstancesWithCinderVolumes-2005022567 None] Acquiring lock "cinder-4b3da968-3239-4878-9f95-9049e6567187-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:42:28 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fde7a3ec-b57a-4bda-9f3b-29ecb75bf218 tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "cinder-4b3da968-3239-4878-9f95-9049e6567187-delete_volume" acquired by "delete_volume" :: waited 0.133s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:42:28 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-fde7a3ec-b57a-4bda-9f3b-29ecb75bf218 tempest-TestInstancesWithCinderVolumes-2005022567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:42:28 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fde7a3ec-b57a-4bda-9f3b-29ecb75bf218 tempest-TestInstancesWithCinderVolumes-2005022567 None] Acquiring lock "cinder-quobyte-4b3da968-3239-4878-9f95-9049e6567187" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:42:28 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fde7a3ec-b57a-4bda-9f3b-29ecb75bf218 tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "cinder-quobyte-4b3da968-3239-4878-9f95-9049e6567187" acquired by "delete_volume" :: waited 0.032s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:42:28 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e02eb7-7270-44b3-91a2-5d084a4f571b]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:42:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fde7a3ec-b57a-4bda-9f3b-29ecb75bf218 tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b3da968-3239-4878-9f95-9049e6567187 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:42:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:42:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:42:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:42:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:42:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:42:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:42:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:42:30 devstack quobyte-client[82814]: System call of process 94833 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:42:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.539s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:42:30 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:42:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fde7a3ec-b57a-4bda-9f3b-29ecb75bf218 tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b3da968-3239-4878-9f95-9049e6567187" returned: 0 in 1.834s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:42:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fde7a3ec-b57a-4bda-9f3b-29ecb75bf218 tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b3da968-3239-4878-9f95-9049e6567187 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:42:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fde7a3ec-b57a-4bda-9f3b-29ecb75bf218 tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b3da968-3239-4878-9f95-9049e6567187" returned: 0 in 1.071s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:42:32 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fde7a3ec-b57a-4bda-9f3b-29ecb75bf218 tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "cinder-quobyte-4b3da968-3239-4878-9f95-9049e6567187" released by "delete_volume" :: held 3.321s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:42:32 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:42:32 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:42:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Flow 'volume_create_manager' (50cb7578-4305-415c-bdcb-6d36092b529a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:42:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9278ea25-1dcc-4476-a5c2-efbd9a0e84b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:42:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9278ea25-1dcc-4476-a5c2-efbd9a0e84b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1115908126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fadfe456-0132-4b3a-b148-2c2f34deac8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9d906d00c7646979fa02dbfdd95ae5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:42:31Z,use_quota=True,user_id='14d1a6101d8b4633a6790929f16d6b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:42:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6de1fad-78ad-4502-a2f7-2cc8da90f496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:42:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6de1fad-78ad-4502-a2f7-2cc8da90f496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:42:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7931b21a-1c37-4790-9b62-01a4b9f235cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:42:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7931b21a-1c37-4790-9b62-01a4b9f235cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fadfe456-0132-4b3a-b148-2c2f34deac8d', 'volume_name': 'volume-fadfe456-0132-4b3a-b148-2c2f34deac8d', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:42:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30693093-6b9b-4110-9b4d-20ef53cb1158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:42:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30693093-6b9b-4110-9b4d-20ef53cb1158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:42:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7678e00b-2529-4863-9f66-9d1d0d3804d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:42:32 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Volume fadfe456-0132-4b3a-b148-2c2f34deac8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fadfe456-0132-4b3a-b148-2c2f34deac8d', 'volume_size': 1} Sep 10 15:42:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:42:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:42:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1115908126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fadfe456-0132-4b3a-b148-2c2f34deac8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9d906d00c7646979fa02dbfdd95ae5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:42:31Z,use_quota=True,user_id='14d1a6101d8b4633a6790929f16d6b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:42:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Creating volume fadfe456-0132-4b3a-b148-2c2f34deac8d {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:42:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:42:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:42:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:42:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:42:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:42:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:42:32 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:42:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-fadfe456-0132-4b3a-b148-2c2f34deac8d 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:42:33 devstack quobyte-client[82814]: System call of process 94847 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:42:33 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=89, name=volume-fadfe456-0132-4b3a-b148-2c2f34deac8d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:42:34 devstack cinder-volume[82800]: WARNING cinder.quota [None req-fde7a3ec-b57a-4bda-9f3b-29ecb75bf218 tempest-TestInstancesWithCinderVolumes-2005022567 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1642002122-1165554070 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1642002122-1165554070, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:42:34 devstack cinder-volume[82800]: WARNING cinder.quota [None req-fde7a3ec-b57a-4bda-9f3b-29ecb75bf218 tempest-TestInstancesWithCinderVolumes-2005022567 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1642002122-1165554070 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1642002122-1165554070, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:42:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-fadfe456-0132-4b3a-b148-2c2f34deac8d 1073741824" returned: 0 in 1.433s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:42:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-fadfe456-0132-4b3a-b148-2c2f34deac8d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:42:34 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-fde7a3ec-b57a-4bda-9f3b-29ecb75bf218 tempest-TestInstancesWithCinderVolumes-2005022567 None] Created reservations ['64e61479-94e8-4175-aa4c-f9a264f85496', 'f545d629-8785-4b02-be59-2f01fc59d788', 'f1dd33c8-c02d-47c2-b7a7-a0b8055fc0de', 'c1ab1be0-d1dc-48b8-9b9b-e98af7d75b12'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:42:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-fadfe456-0132-4b3a-b148-2c2f34deac8d" returned: 0 in 1.009s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:42:35 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] <== create_volume: return (2510ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:42:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.543s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:42:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7678e00b-2529-4863-9f66-9d1d0d3804d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fadfe456-0132-4b3a-b148-2c2f34deac8d', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:42:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c237fc2d-2846-4b82-8c7e-db744fa0851d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:42:35 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Volume volume-fadfe456-0132-4b3a-b148-2c2f34deac8d (fadfe456-0132-4b3a-b148-2c2f34deac8d): created successfully Sep 10 15:42:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c237fc2d-2846-4b82-8c7e-db744fa0851d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:42:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Flow 'volume_create_manager' (50cb7578-4305-415c-bdcb-6d36092b529a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:42:35 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-9084e8c6-04ec-4753-a08e-a7123ddd7283 tempest-AttachVolumeNegativeTest-150614502 None] Created volume successfully. Sep 10 15:42:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-fde7a3ec-b57a-4bda-9f3b-29ecb75bf218 tempest-TestInstancesWithCinderVolumes-2005022567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:42:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-fde7a3ec-b57a-4bda-9f3b-29ecb75bf218 tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:42:36 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-fde7a3ec-b57a-4bda-9f3b-29ecb75bf218 tempest-TestInstancesWithCinderVolumes-2005022567 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:42:36 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-fde7a3ec-b57a-4bda-9f3b-29ecb75bf218 tempest-TestInstancesWithCinderVolumes-2005022567 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:42:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-fde7a3ec-b57a-4bda-9f3b-29ecb75bf218 tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:42:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fde7a3ec-b57a-4bda-9f3b-29ecb75bf218 tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:42:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fde7a3ec-b57a-4bda-9f3b-29ecb75bf218 tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.955s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:42:37 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-fde7a3ec-b57a-4bda-9f3b-29ecb75bf218 tempest-TestInstancesWithCinderVolumes-2005022567 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:42:37 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-fde7a3ec-b57a-4bda-9f3b-29ecb75bf218 tempest-TestInstancesWithCinderVolumes-2005022567 None] Deleted volume successfully. Sep 10 15:42:37 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fde7a3ec-b57a-4bda-9f3b-29ecb75bf218 tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "cinder-4b3da968-3239-4878-9f95-9049e6567187-delete_volume" released by "delete_volume" :: held 8.927s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:42:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-cd8ac91f-eb76-45b2-86ca-33b10037ba56 req-2c2e4029-f559-4730-bb7f-4dd95f28ae53 tempest-AttachVolumeNegativeTest-150614502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:42:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-cd8ac91f-eb76-45b2-86ca-33b10037ba56 req-2c2e4029-f559-4730-bb7f-4dd95f28ae53 tempest-AttachVolumeNegativeTest-150614502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:42:43 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[170d4661-4477-4217-81c5-3a192bc0a4ae]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:42:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-cd8ac91f-eb76-45b2-86ca-33b10037ba56 req-2c2e4029-f559-4730-bb7f-4dd95f28ae53 tempest-AttachVolumeNegativeTest-150614502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-fadfe456-0132-4b3a-b148-2c2f34deac8d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:42:44 devstack quobyte-client[82814]: System call of process 94987 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:42:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-cd8ac91f-eb76-45b2-86ca-33b10037ba56 req-2c2e4029-f559-4730-bb7f-4dd95f28ae53 tempest-AttachVolumeNegativeTest-150614502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-fadfe456-0132-4b3a-b148-2c2f34deac8d" returned: 0 in 0.818s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:42:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-cd8ac91f-eb76-45b2-86ca-33b10037ba56 req-2c2e4029-f559-4730-bb7f-4dd95f28ae53 tempest-AttachVolumeNegativeTest-150614502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.031s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:42:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-cd8ac91f-eb76-45b2-86ca-33b10037ba56 req-2c2e4029-f559-4730-bb7f-4dd95f28ae53 tempest-AttachVolumeNegativeTest-150614502 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5', 'name': 'volume-fadfe456-0132-4b3a-b148-2c2f34deac8d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c2752fab-c2c1-460f-b74b-8c0f0e55e17c', 'enforce_multipath': True} {{(pid=82800) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 15:42:45 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-cd8ac91f-eb76-45b2-86ca-33b10037ba56 req-2c2e4029-f559-4730-bb7f-4dd95f28ae53 tempest-AttachVolumeNegativeTest-150614502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:42:45 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-cd8ac91f-eb76-45b2-86ca-33b10037ba56 req-2c2e4029-f559-4730-bb7f-4dd95f28ae53 tempest-AttachVolumeNegativeTest-150614502 None] attachment_update completed successfully. Sep 10 15:42:55 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=12,cinder:UPDATE=14,cinder:INSERT=4 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:42:55 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=13,cinder:UPDATE=9,cinder:DELETE=2 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:43:00 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d63adb98-370b-4925-89ff-62756796f509 tempest-VolumesNegativeTest-1397623248 None] Acquiring lock "cinder-bcdb16c1-c2c9-472a-b4a9-6bcc5efd1984-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:43:00 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d63adb98-370b-4925-89ff-62756796f509 tempest-VolumesNegativeTest-1397623248 None] Lock "cinder-bcdb16c1-c2c9-472a-b4a9-6bcc5efd1984-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:43:00 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-d63adb98-370b-4925-89ff-62756796f509 tempest-VolumesNegativeTest-1397623248 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:43:00 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d63adb98-370b-4925-89ff-62756796f509 tempest-VolumesNegativeTest-1397623248 None] Acquiring lock "cinder-quobyte-bcdb16c1-c2c9-472a-b4a9-6bcc5efd1984" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:43:00 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d63adb98-370b-4925-89ff-62756796f509 tempest-VolumesNegativeTest-1397623248 None] Lock "cinder-quobyte-bcdb16c1-c2c9-472a-b4a9-6bcc5efd1984" acquired by "delete_volume" :: waited 0.018s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:43:00 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[8964e68c-271d-472c-aae0-09cef5535fb4]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:43:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d63adb98-370b-4925-89ff-62756796f509 tempest-VolumesNegativeTest-1397623248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bcdb16c1-c2c9-472a-b4a9-6bcc5efd1984 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:43:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d63adb98-370b-4925-89ff-62756796f509 tempest-VolumesNegativeTest-1397623248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bcdb16c1-c2c9-472a-b4a9-6bcc5efd1984" returned: 0 in 0.429s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:43:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d63adb98-370b-4925-89ff-62756796f509 tempest-VolumesNegativeTest-1397623248 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bcdb16c1-c2c9-472a-b4a9-6bcc5efd1984 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:43:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d63adb98-370b-4925-89ff-62756796f509 tempest-VolumesNegativeTest-1397623248 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bcdb16c1-c2c9-472a-b4a9-6bcc5efd1984" returned: 0 in 0.108s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:43:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d63adb98-370b-4925-89ff-62756796f509 tempest-VolumesNegativeTest-1397623248 None] Lock "cinder-quobyte-bcdb16c1-c2c9-472a-b4a9-6bcc5efd1984" released by "delete_volume" :: held 0.710s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:43:01 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-d63adb98-370b-4925-89ff-62756796f509 tempest-VolumesNegativeTest-1397623248 None] Created reservations ['661174ab-2d4b-4fa4-ac3d-2af61c3da0a7', '7bbc949c-733a-47bd-b512-0c6e7b7b65d4', '24f8df9b-4998-4366-9ad5-ca82e9c5e538', '31c68e4a-95b8-42bd-8227-c3a479353a27'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:43:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d63adb98-370b-4925-89ff-62756796f509 tempest-VolumesNegativeTest-1397623248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:43:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d63adb98-370b-4925-89ff-62756796f509 tempest-VolumesNegativeTest-1397623248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:43:01 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d63adb98-370b-4925-89ff-62756796f509 tempest-VolumesNegativeTest-1397623248 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:43:01 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d63adb98-370b-4925-89ff-62756796f509 tempest-VolumesNegativeTest-1397623248 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:43:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d63adb98-370b-4925-89ff-62756796f509 tempest-VolumesNegativeTest-1397623248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:43:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d63adb98-370b-4925-89ff-62756796f509 tempest-VolumesNegativeTest-1397623248 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:43:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d63adb98-370b-4925-89ff-62756796f509 tempest-VolumesNegativeTest-1397623248 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.100s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:43:02 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-d63adb98-370b-4925-89ff-62756796f509 tempest-VolumesNegativeTest-1397623248 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:43:02 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-d63adb98-370b-4925-89ff-62756796f509 tempest-VolumesNegativeTest-1397623248 None] Deleted volume successfully. Sep 10 15:43:02 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d63adb98-370b-4925-89ff-62756796f509 tempest-VolumesNegativeTest-1397623248 None] Lock "cinder-bcdb16c1-c2c9-472a-b4a9-6bcc5efd1984-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:43:05 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-b0bc821d-c463-41ee-96c4-7d56b3baf27f req-309e71d3-6d82-4fa2-a19a-8e2c2121d8f1 tempest-TestInstancesWithCinderVolumes-2005022567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:43:05 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-b0bc821d-c463-41ee-96c4-7d56b3baf27f req-309e71d3-6d82-4fa2-a19a-8e2c2121d8f1 tempest-TestInstancesWithCinderVolumes-2005022567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:43:05 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-b0bc821d-c463-41ee-96c4-7d56b3baf27f req-309e71d3-6d82-4fa2-a19a-8e2c2121d8f1 tempest-TestInstancesWithCinderVolumes-2005022567 None] Terminate volume connection completed successfully. Sep 10 15:43:05 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-b0bc821d-c463-41ee-96c4-7d56b3baf27f req-309e71d3-6d82-4fa2-a19a-8e2c2121d8f1 tempest-TestInstancesWithCinderVolumes-2005022567 None] Deleting attachment 3ea13f1d-6b5b-4288-a048-a9d992ed6512. {{(pid=82800) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 15:43:07 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-23214b98-054e-4f3d-855e-1c0faba3a5b4 tempest-TestInstancesWithCinderVolumes-2005022567 None] Acquiring lock "cinder-535bb65a-c71f-4d55-b2f3-dd9b2ad61945-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:43:07 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-23214b98-054e-4f3d-855e-1c0faba3a5b4 tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "cinder-535bb65a-c71f-4d55-b2f3-dd9b2ad61945-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:43:07 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-23214b98-054e-4f3d-855e-1c0faba3a5b4 tempest-TestInstancesWithCinderVolumes-2005022567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:43:07 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-23214b98-054e-4f3d-855e-1c0faba3a5b4 tempest-TestInstancesWithCinderVolumes-2005022567 None] Acquiring lock "cinder-quobyte-535bb65a-c71f-4d55-b2f3-dd9b2ad61945" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:43:07 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-23214b98-054e-4f3d-855e-1c0faba3a5b4 tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "cinder-quobyte-535bb65a-c71f-4d55-b2f3-dd9b2ad61945" acquired by "delete_volume" :: waited 0.023s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:43:07 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1c9e8c-cb8e-41f9-a577-319691123c34]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:43:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-23214b98-054e-4f3d-855e-1c0faba3a5b4 tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-535bb65a-c71f-4d55-b2f3-dd9b2ad61945 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:43:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-23214b98-054e-4f3d-855e-1c0faba3a5b4 tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-535bb65a-c71f-4d55-b2f3-dd9b2ad61945" returned: 0 in 0.616s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:43:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-23214b98-054e-4f3d-855e-1c0faba3a5b4 tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-535bb65a-c71f-4d55-b2f3-dd9b2ad61945 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:43:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-23214b98-054e-4f3d-855e-1c0faba3a5b4 tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-535bb65a-c71f-4d55-b2f3-dd9b2ad61945" returned: 0 in 0.162s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:43:08 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-23214b98-054e-4f3d-855e-1c0faba3a5b4 tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "cinder-quobyte-535bb65a-c71f-4d55-b2f3-dd9b2ad61945" released by "delete_volume" :: held 1.118s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:43:08 devstack cinder-volume[82800]: WARNING cinder.quota [None req-23214b98-054e-4f3d-855e-1c0faba3a5b4 tempest-TestInstancesWithCinderVolumes-2005022567 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1544775387-790628739 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1544775387-790628739, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:43:08 devstack cinder-volume[82800]: WARNING cinder.quota [None req-23214b98-054e-4f3d-855e-1c0faba3a5b4 tempest-TestInstancesWithCinderVolumes-2005022567 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1544775387-790628739 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1544775387-790628739, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:43:08 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-23214b98-054e-4f3d-855e-1c0faba3a5b4 tempest-TestInstancesWithCinderVolumes-2005022567 None] Created reservations ['6894cae8-f345-44e9-8962-81eebb452cfe', '4f8f0f7b-021d-4c5a-91e1-8b332ee5d4f9', '33792545-dbb4-417b-a961-dc82ee61c757', '5661bebd-6a01-4390-94fd-9240b31b1ef3'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:43:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-23214b98-054e-4f3d-855e-1c0faba3a5b4 tempest-TestInstancesWithCinderVolumes-2005022567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:43:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-23214b98-054e-4f3d-855e-1c0faba3a5b4 tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:43:09 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-23214b98-054e-4f3d-855e-1c0faba3a5b4 tempest-TestInstancesWithCinderVolumes-2005022567 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:43:09 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-23214b98-054e-4f3d-855e-1c0faba3a5b4 tempest-TestInstancesWithCinderVolumes-2005022567 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:43:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-23214b98-054e-4f3d-855e-1c0faba3a5b4 tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:43:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-23214b98-054e-4f3d-855e-1c0faba3a5b4 tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:43:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-23214b98-054e-4f3d-855e-1c0faba3a5b4 tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.213s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:43:09 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-23214b98-054e-4f3d-855e-1c0faba3a5b4 tempest-TestInstancesWithCinderVolumes-2005022567 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:43:09 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-23214b98-054e-4f3d-855e-1c0faba3a5b4 tempest-TestInstancesWithCinderVolumes-2005022567 None] Deleted volume successfully. Sep 10 15:43:09 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-23214b98-054e-4f3d-855e-1c0faba3a5b4 tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "cinder-535bb65a-c71f-4d55-b2f3-dd9b2ad61945-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:43:15 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-d9281648-b7c2-4dbe-9b45-0b11661dfc33 req-b79f90a6-b223-409a-a8d8-dc8d82444c87 tempest-AttachVolumeNegativeTest-150614502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:43:15 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-d9281648-b7c2-4dbe-9b45-0b11661dfc33 req-b79f90a6-b223-409a-a8d8-dc8d82444c87 tempest-AttachVolumeNegativeTest-150614502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:43:15 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-d9281648-b7c2-4dbe-9b45-0b11661dfc33 req-b79f90a6-b223-409a-a8d8-dc8d82444c87 tempest-AttachVolumeNegativeTest-150614502 None] Terminate volume connection completed successfully. Sep 10 15:43:15 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-d9281648-b7c2-4dbe-9b45-0b11661dfc33 req-b79f90a6-b223-409a-a8d8-dc8d82444c87 tempest-AttachVolumeNegativeTest-150614502 None] Deleting attachment c2752fab-c2c1-460f-b74b-8c0f0e55e17c. {{(pid=82800) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 15:43:18 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-530a50ec-cec9-4162-a993-5a169b4e3aec req-d5cdb194-4f62-45da-8857-b8d56061ab04 tempest-TestInstancesWithCinderVolumes-2005022567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:43:18 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-530a50ec-cec9-4162-a993-5a169b4e3aec req-d5cdb194-4f62-45da-8857-b8d56061ab04 tempest-TestInstancesWithCinderVolumes-2005022567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:43:18 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-530a50ec-cec9-4162-a993-5a169b4e3aec req-d5cdb194-4f62-45da-8857-b8d56061ab04 tempest-TestInstancesWithCinderVolumes-2005022567 None] Terminate volume connection completed successfully. Sep 10 15:43:18 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-530a50ec-cec9-4162-a993-5a169b4e3aec req-d5cdb194-4f62-45da-8857-b8d56061ab04 tempest-TestInstancesWithCinderVolumes-2005022567 None] Deleting attachment 67fe440a-f814-41fb-ad97-7112de885099. {{(pid=82800) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 15:43:22 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d77b8dd9-07a7-437b-99f7-3a39dbcb18ed tempest-TestInstancesWithCinderVolumes-2005022567 None] Acquiring lock "cinder-8f79c729-a710-4707-acc7-92deb2b009ab-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:43:22 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d77b8dd9-07a7-437b-99f7-3a39dbcb18ed tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "cinder-8f79c729-a710-4707-acc7-92deb2b009ab-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:43:22 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-d77b8dd9-07a7-437b-99f7-3a39dbcb18ed tempest-TestInstancesWithCinderVolumes-2005022567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:43:22 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d77b8dd9-07a7-437b-99f7-3a39dbcb18ed tempest-TestInstancesWithCinderVolumes-2005022567 None] Acquiring lock "cinder-quobyte-8f79c729-a710-4707-acc7-92deb2b009ab" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:43:22 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d77b8dd9-07a7-437b-99f7-3a39dbcb18ed tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "cinder-quobyte-8f79c729-a710-4707-acc7-92deb2b009ab" acquired by "delete_volume" :: waited 0.024s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:43:23 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[99810645-3759-4880-aaa9-377af85d0062]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:43:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d77b8dd9-07a7-437b-99f7-3a39dbcb18ed tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8f79c729-a710-4707-acc7-92deb2b009ab {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:43:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d77b8dd9-07a7-437b-99f7-3a39dbcb18ed tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8f79c729-a710-4707-acc7-92deb2b009ab" returned: 0 in 0.844s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:43:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d77b8dd9-07a7-437b-99f7-3a39dbcb18ed tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8f79c729-a710-4707-acc7-92deb2b009ab {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:43:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d77b8dd9-07a7-437b-99f7-3a39dbcb18ed tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8f79c729-a710-4707-acc7-92deb2b009ab" returned: 1 in 0.943s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:43:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d77b8dd9-07a7-437b-99f7-3a39dbcb18ed tempest-TestInstancesWithCinderVolumes-2005022567 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8f79c729-a710-4707-acc7-92deb2b009ab' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:43:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d77b8dd9-07a7-437b-99f7-3a39dbcb18ed tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8f79c729-a710-4707-acc7-92deb2b009ab {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:43:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d77b8dd9-07a7-437b-99f7-3a39dbcb18ed tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8f79c729-a710-4707-acc7-92deb2b009ab" returned: 0 in 0.188s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:43:25 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d77b8dd9-07a7-437b-99f7-3a39dbcb18ed tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "cinder-quobyte-8f79c729-a710-4707-acc7-92deb2b009ab" released by "delete_volume" :: held 2.501s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:43:25 devstack cinder-volume[82800]: WARNING cinder.quota [None req-d77b8dd9-07a7-437b-99f7-3a39dbcb18ed tempest-TestInstancesWithCinderVolumes-2005022567 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-958478317-855583524 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-958478317-855583524, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:43:25 devstack cinder-volume[82800]: WARNING cinder.quota [None req-d77b8dd9-07a7-437b-99f7-3a39dbcb18ed tempest-TestInstancesWithCinderVolumes-2005022567 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-958478317-855583524 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-958478317-855583524, it is now deprecated. Please use the default quota class for default quota. Sep 10 15:43:25 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-d77b8dd9-07a7-437b-99f7-3a39dbcb18ed tempest-TestInstancesWithCinderVolumes-2005022567 None] Created reservations ['8150e80d-c6f0-4a85-9bc4-28d634fc1bd1', 'b04d29b2-d26f-4b3d-a2b5-bf2796e3e873', '0a967dbc-2bdb-423b-8399-262aca9312ec', '6c88c81b-b629-4ac8-9709-1800ed16dfc4'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:43:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d77b8dd9-07a7-437b-99f7-3a39dbcb18ed tempest-TestInstancesWithCinderVolumes-2005022567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:43:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d77b8dd9-07a7-437b-99f7-3a39dbcb18ed tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:43:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d77b8dd9-07a7-437b-99f7-3a39dbcb18ed tempest-TestInstancesWithCinderVolumes-2005022567 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:43:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d77b8dd9-07a7-437b-99f7-3a39dbcb18ed tempest-TestInstancesWithCinderVolumes-2005022567 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:43:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d77b8dd9-07a7-437b-99f7-3a39dbcb18ed tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:43:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d77b8dd9-07a7-437b-99f7-3a39dbcb18ed tempest-TestInstancesWithCinderVolumes-2005022567 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:43:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d77b8dd9-07a7-437b-99f7-3a39dbcb18ed tempest-TestInstancesWithCinderVolumes-2005022567 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.166s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:43:26 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-d77b8dd9-07a7-437b-99f7-3a39dbcb18ed tempest-TestInstancesWithCinderVolumes-2005022567 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:43:26 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-d77b8dd9-07a7-437b-99f7-3a39dbcb18ed tempest-TestInstancesWithCinderVolumes-2005022567 None] Deleted volume successfully. Sep 10 15:43:26 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d77b8dd9-07a7-437b-99f7-3a39dbcb18ed tempest-TestInstancesWithCinderVolumes-2005022567 None] Lock "cinder-8f79c729-a710-4707-acc7-92deb2b009ab-delete_volume" released by "delete_volume" :: held 4.394s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:43:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:43:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:43:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.027s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:43:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:43:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:43:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.061s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:43:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:43:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.436s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:43:30 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:43:36 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=33,cinder:SELECT=19,cinder:INSERT=3,cinder:DELETE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:43:36 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=18,cinder:INSERT=9,cinder:UPDATE=16,cinder:DELETE=2 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:43:37 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c7c43c3a-a4bd-4f2f-96d9-29fcdeeafa7b tempest-AttachVolumeNegativeTest-150614502 None] Acquiring lock "cinder-fadfe456-0132-4b3a-b148-2c2f34deac8d-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:43:37 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c7c43c3a-a4bd-4f2f-96d9-29fcdeeafa7b tempest-AttachVolumeNegativeTest-150614502 None] Lock "cinder-fadfe456-0132-4b3a-b148-2c2f34deac8d-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:43:38 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-c7c43c3a-a4bd-4f2f-96d9-29fcdeeafa7b tempest-AttachVolumeNegativeTest-150614502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:43:38 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c7c43c3a-a4bd-4f2f-96d9-29fcdeeafa7b tempest-AttachVolumeNegativeTest-150614502 None] Acquiring lock "cinder-quobyte-fadfe456-0132-4b3a-b148-2c2f34deac8d" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:43:38 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c7c43c3a-a4bd-4f2f-96d9-29fcdeeafa7b tempest-AttachVolumeNegativeTest-150614502 None] Lock "cinder-quobyte-fadfe456-0132-4b3a-b148-2c2f34deac8d" acquired by "delete_volume" :: waited 0.049s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:43:38 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5940df-2660-4e0b-a968-2473f19c0042]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:43:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c7c43c3a-a4bd-4f2f-96d9-29fcdeeafa7b tempest-AttachVolumeNegativeTest-150614502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-fadfe456-0132-4b3a-b148-2c2f34deac8d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:43:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c7c43c3a-a4bd-4f2f-96d9-29fcdeeafa7b tempest-AttachVolumeNegativeTest-150614502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-fadfe456-0132-4b3a-b148-2c2f34deac8d" returned: 0 in 0.930s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:43:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c7c43c3a-a4bd-4f2f-96d9-29fcdeeafa7b tempest-AttachVolumeNegativeTest-150614502 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-fadfe456-0132-4b3a-b148-2c2f34deac8d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:43:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c7c43c3a-a4bd-4f2f-96d9-29fcdeeafa7b tempest-AttachVolumeNegativeTest-150614502 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-fadfe456-0132-4b3a-b148-2c2f34deac8d" returned: 0 in 0.142s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:43:39 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c7c43c3a-a4bd-4f2f-96d9-29fcdeeafa7b tempest-AttachVolumeNegativeTest-150614502 None] Lock "cinder-quobyte-fadfe456-0132-4b3a-b148-2c2f34deac8d" released by "delete_volume" :: held 1.391s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:43:40 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-c7c43c3a-a4bd-4f2f-96d9-29fcdeeafa7b tempest-AttachVolumeNegativeTest-150614502 None] Created reservations ['0c737fe3-ddbc-425a-a4fd-8b02790b22ca', 'b1741785-c6e0-4ecb-a710-9b6c07ceb53b', '0403d067-1a62-4c1d-a845-be57933816d5', '0ea1ec04-7aaa-4392-902d-7e6f3e9ee817'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:43:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c7c43c3a-a4bd-4f2f-96d9-29fcdeeafa7b tempest-AttachVolumeNegativeTest-150614502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:43:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c7c43c3a-a4bd-4f2f-96d9-29fcdeeafa7b tempest-AttachVolumeNegativeTest-150614502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:43:40 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c7c43c3a-a4bd-4f2f-96d9-29fcdeeafa7b tempest-AttachVolumeNegativeTest-150614502 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:43:40 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c7c43c3a-a4bd-4f2f-96d9-29fcdeeafa7b tempest-AttachVolumeNegativeTest-150614502 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:43:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c7c43c3a-a4bd-4f2f-96d9-29fcdeeafa7b tempest-AttachVolumeNegativeTest-150614502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:43:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c7c43c3a-a4bd-4f2f-96d9-29fcdeeafa7b tempest-AttachVolumeNegativeTest-150614502 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:43:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c7c43c3a-a4bd-4f2f-96d9-29fcdeeafa7b tempest-AttachVolumeNegativeTest-150614502 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.129s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:43:40 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-c7c43c3a-a4bd-4f2f-96d9-29fcdeeafa7b tempest-AttachVolumeNegativeTest-150614502 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:43:40 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-c7c43c3a-a4bd-4f2f-96d9-29fcdeeafa7b tempest-AttachVolumeNegativeTest-150614502 None] Deleted volume successfully. Sep 10 15:43:40 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c7c43c3a-a4bd-4f2f-96d9-29fcdeeafa7b tempest-AttachVolumeNegativeTest-150614502 None] Lock "cinder-fadfe456-0132-4b3a-b148-2c2f34deac8d-delete_volume" released by "delete_volume" :: held 3.249s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:43:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-543f309e-26c7-46b5-8658-ff03e0b32cbf tempest-AttachVolumeNegativeTest-150614502 None] Acquiring lock "cinder-d24cd94a-7068-4d6d-b69b-fb03aa025f6a-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:43:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-543f309e-26c7-46b5-8658-ff03e0b32cbf tempest-AttachVolumeNegativeTest-150614502 None] Lock "cinder-d24cd94a-7068-4d6d-b69b-fb03aa025f6a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:43:41 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-543f309e-26c7-46b5-8658-ff03e0b32cbf tempest-AttachVolumeNegativeTest-150614502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:43:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-543f309e-26c7-46b5-8658-ff03e0b32cbf tempest-AttachVolumeNegativeTest-150614502 None] Acquiring lock "cinder-quobyte-d24cd94a-7068-4d6d-b69b-fb03aa025f6a" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:43:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-543f309e-26c7-46b5-8658-ff03e0b32cbf tempest-AttachVolumeNegativeTest-150614502 None] Lock "cinder-quobyte-d24cd94a-7068-4d6d-b69b-fb03aa025f6a" acquired by "delete_volume" :: waited 0.013s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:43:41 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[203189ca-d7e1-49b8-941e-99ae1273a4a2]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:43:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-543f309e-26c7-46b5-8658-ff03e0b32cbf tempest-AttachVolumeNegativeTest-150614502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-d24cd94a-7068-4d6d-b69b-fb03aa025f6a {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:43:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-543f309e-26c7-46b5-8658-ff03e0b32cbf tempest-AttachVolumeNegativeTest-150614502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-d24cd94a-7068-4d6d-b69b-fb03aa025f6a" returned: 0 in 0.554s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:43:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-543f309e-26c7-46b5-8658-ff03e0b32cbf tempest-AttachVolumeNegativeTest-150614502 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-d24cd94a-7068-4d6d-b69b-fb03aa025f6a {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:43:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-543f309e-26c7-46b5-8658-ff03e0b32cbf tempest-AttachVolumeNegativeTest-150614502 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-d24cd94a-7068-4d6d-b69b-fb03aa025f6a" returned: 0 in 0.203s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:43:42 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-543f309e-26c7-46b5-8658-ff03e0b32cbf tempest-AttachVolumeNegativeTest-150614502 None] Lock "cinder-quobyte-d24cd94a-7068-4d6d-b69b-fb03aa025f6a" released by "delete_volume" :: held 1.103s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:43:43 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-543f309e-26c7-46b5-8658-ff03e0b32cbf tempest-AttachVolumeNegativeTest-150614502 None] Created reservations ['9a56ee7e-45a6-4eda-9fb8-c3d7e6796676', 'fe07e297-ea4a-4e1e-8524-6582cf430e34', '44191b82-4358-46f1-8a9d-6590969e94f2', 'f79eaedf-84eb-4a09-a87f-af47949ef1b9'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:43:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-543f309e-26c7-46b5-8658-ff03e0b32cbf tempest-AttachVolumeNegativeTest-150614502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:43:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-543f309e-26c7-46b5-8658-ff03e0b32cbf tempest-AttachVolumeNegativeTest-150614502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:43:43 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-543f309e-26c7-46b5-8658-ff03e0b32cbf tempest-AttachVolumeNegativeTest-150614502 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:43:43 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-543f309e-26c7-46b5-8658-ff03e0b32cbf tempest-AttachVolumeNegativeTest-150614502 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:43:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-543f309e-26c7-46b5-8658-ff03e0b32cbf tempest-AttachVolumeNegativeTest-150614502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:43:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-543f309e-26c7-46b5-8658-ff03e0b32cbf tempest-AttachVolumeNegativeTest-150614502 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:43:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-543f309e-26c7-46b5-8658-ff03e0b32cbf tempest-AttachVolumeNegativeTest-150614502 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.164s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:43:43 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-543f309e-26c7-46b5-8658-ff03e0b32cbf tempest-AttachVolumeNegativeTest-150614502 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:43:43 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-543f309e-26c7-46b5-8658-ff03e0b32cbf tempest-AttachVolumeNegativeTest-150614502 None] Deleted volume successfully. Sep 10 15:43:44 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-543f309e-26c7-46b5-8658-ff03e0b32cbf tempest-AttachVolumeNegativeTest-150614502 None] Lock "cinder-d24cd94a-7068-4d6d-b69b-fb03aa025f6a-delete_volume" released by "delete_volume" :: held 2.806s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:43:44 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-54c7676f-171f-4e2a-8506-2e8e40473a96 tempest-AttachVolumeNegativeTest-150614502 None] Acquiring lock "cinder-580e3e7d-9925-40dd-b9ff-6f2c39b585cc-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:43:44 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-54c7676f-171f-4e2a-8506-2e8e40473a96 tempest-AttachVolumeNegativeTest-150614502 None] Lock "cinder-580e3e7d-9925-40dd-b9ff-6f2c39b585cc-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:43:44 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-54c7676f-171f-4e2a-8506-2e8e40473a96 tempest-AttachVolumeNegativeTest-150614502 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:43:44 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-54c7676f-171f-4e2a-8506-2e8e40473a96 tempest-AttachVolumeNegativeTest-150614502 None] Acquiring lock "cinder-quobyte-580e3e7d-9925-40dd-b9ff-6f2c39b585cc" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:43:44 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-54c7676f-171f-4e2a-8506-2e8e40473a96 tempest-AttachVolumeNegativeTest-150614502 None] Lock "cinder-quobyte-580e3e7d-9925-40dd-b9ff-6f2c39b585cc" acquired by "delete_volume" :: waited 0.041s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:43:44 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[5058b538-aa2f-43af-bd7b-19516a84ecb3]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:43:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-54c7676f-171f-4e2a-8506-2e8e40473a96 tempest-AttachVolumeNegativeTest-150614502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-580e3e7d-9925-40dd-b9ff-6f2c39b585cc {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:43:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-54c7676f-171f-4e2a-8506-2e8e40473a96 tempest-AttachVolumeNegativeTest-150614502 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-580e3e7d-9925-40dd-b9ff-6f2c39b585cc" returned: 0 in 0.987s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:43:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-54c7676f-171f-4e2a-8506-2e8e40473a96 tempest-AttachVolumeNegativeTest-150614502 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-580e3e7d-9925-40dd-b9ff-6f2c39b585cc {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:43:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-54c7676f-171f-4e2a-8506-2e8e40473a96 tempest-AttachVolumeNegativeTest-150614502 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-580e3e7d-9925-40dd-b9ff-6f2c39b585cc" returned: 0 in 0.184s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:43:46 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-54c7676f-171f-4e2a-8506-2e8e40473a96 tempest-AttachVolumeNegativeTest-150614502 None] Lock "cinder-quobyte-580e3e7d-9925-40dd-b9ff-6f2c39b585cc" released by "delete_volume" :: held 1.553s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:43:46 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-54c7676f-171f-4e2a-8506-2e8e40473a96 tempest-AttachVolumeNegativeTest-150614502 None] Created reservations ['d82740f0-bd5c-47cf-b260-f8ee1c3b59b5', '36de4e50-24b2-4d6d-a70d-e48477a74129', '696ec99a-8162-4611-9110-9661e318ce7b', '6c8a9da5-a82c-4519-a3fe-22f83286f672'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:43:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-54c7676f-171f-4e2a-8506-2e8e40473a96 tempest-AttachVolumeNegativeTest-150614502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:43:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-54c7676f-171f-4e2a-8506-2e8e40473a96 tempest-AttachVolumeNegativeTest-150614502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:43:47 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-54c7676f-171f-4e2a-8506-2e8e40473a96 tempest-AttachVolumeNegativeTest-150614502 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:43:47 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-54c7676f-171f-4e2a-8506-2e8e40473a96 tempest-AttachVolumeNegativeTest-150614502 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:43:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-54c7676f-171f-4e2a-8506-2e8e40473a96 tempest-AttachVolumeNegativeTest-150614502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:43:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-54c7676f-171f-4e2a-8506-2e8e40473a96 tempest-AttachVolumeNegativeTest-150614502 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:43:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-54c7676f-171f-4e2a-8506-2e8e40473a96 tempest-AttachVolumeNegativeTest-150614502 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.247s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:43:47 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-54c7676f-171f-4e2a-8506-2e8e40473a96 tempest-AttachVolumeNegativeTest-150614502 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:43:47 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-54c7676f-171f-4e2a-8506-2e8e40473a96 tempest-AttachVolumeNegativeTest-150614502 None] Deleted volume successfully. Sep 10 15:43:47 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-54c7676f-171f-4e2a-8506-2e8e40473a96 tempest-AttachVolumeNegativeTest-150614502 None] Lock "cinder-580e3e7d-9925-40dd-b9ff-6f2c39b585cc-delete_volume" released by "delete_volume" :: held 3.527s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:43:57 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=18,cinder:INSERT=3,cinder:UPDATE=27,cinder:DELETE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:43:57 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=12,cinder:UPDATE=21,cinder:INSERT=9,cinder:DELETE=2 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:44:07 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:44:07 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:44:07 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Flow 'volume_create_manager' (8ce20c0a-e67d-4cd3-b09d-a25c4452287a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:44:07 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (045084d3-7aa6-4f06-a27d-86e6e0940d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:07 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (045084d3-7aa6-4f06-a27d-86e6e0940d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-178230647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b75ec01-18bb-4fec-883e-2f48b70e1b57,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c06f02e11a5449ea857b287599c554b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:44:07Z,use_quota=True,user_id='5d620d1bc822464fb1a4be51a416c559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:07 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dd797de-8a16-48d5-87d9-c066ff917faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:07 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dd797de-8a16-48d5-87d9-c066ff917faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:07 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (677c650d-5975-4461-b7e2-8d7f6539b981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:07 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (677c650d-5975-4461-b7e2-8d7f6539b981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b75ec01-18bb-4fec-883e-2f48b70e1b57', 'volume_name': 'volume-3b75ec01-18bb-4fec-883e-2f48b70e1b57', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:07 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ade03f-631f-4c30-8ebe-21662d6da8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:07 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ade03f-631f-4c30-8ebe-21662d6da8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:07 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fde9110-4e7b-4f22-aeed-c4563e181cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:07 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Volume 3b75ec01-18bb-4fec-883e-2f48b70e1b57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b75ec01-18bb-4fec-883e-2f48b70e1b57', 'volume_size': 1} Sep 10 15:44:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:44:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:44:07 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-178230647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b75ec01-18bb-4fec-883e-2f48b70e1b57,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c06f02e11a5449ea857b287599c554b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:44:07Z,use_quota=True,user_id='5d620d1bc822464fb1a4be51a416c559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:44:07 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Creating volume 3b75ec01-18bb-4fec-883e-2f48b70e1b57 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:44:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:44:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:44:07 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:44:07 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:44:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:44:07 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:44:07 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:44:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3b75ec01-18bb-4fec-883e-2f48b70e1b57 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:44:07 devstack quobyte-client[82814]: System call of process 95222 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:44:07 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=90, name=volume-3b75ec01-18bb-4fec-883e-2f48b70e1b57, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:44:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3b75ec01-18bb-4fec-883e-2f48b70e1b57 1073741824" returned: 0 in 0.721s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:44:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3b75ec01-18bb-4fec-883e-2f48b70e1b57 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:44:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3b75ec01-18bb-4fec-883e-2f48b70e1b57" returned: 0 in 0.227s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:44:08 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] <== create_volume: return (1188ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:44:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:44:09 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fde9110-4e7b-4f22-aeed-c4563e181cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b75ec01-18bb-4fec-883e-2f48b70e1b57', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:09 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f390b8-b51a-4504-af0d-85010489e61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:09 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Volume volume-3b75ec01-18bb-4fec-883e-2f48b70e1b57 (3b75ec01-18bb-4fec-883e-2f48b70e1b57): created successfully Sep 10 15:44:09 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f390b8-b51a-4504-af0d-85010489e61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:09 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Flow 'volume_create_manager' (8ce20c0a-e67d-4cd3-b09d-a25c4452287a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:44:09 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-a6f2adcc-b803-499e-af6e-23b86c0aeb2e req-849d3df3-5e7d-4928-a72d-f6d95c74d267 tempest-VolumesGetTestJSON-801496784 None] Created volume successfully. Sep 10 15:44:10 devstack cinder-volume[82800]: DEBUG cinder.coordination [req-8c6bc5f5-bb91-4504-b995-61950320a725 req-bf461ec6-fa09-4315-965c-339f96fe0296 tempest-VolumesGetTestJSON-801496784 None] Acquiring lock "cinder-3b75ec01-18bb-4fec-883e-2f48b70e1b57-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:44:10 devstack cinder-volume[82800]: DEBUG cinder.coordination [req-8c6bc5f5-bb91-4504-b995-61950320a725 req-bf461ec6-fa09-4315-965c-339f96fe0296 tempest-VolumesGetTestJSON-801496784 None] Lock "cinder-3b75ec01-18bb-4fec-883e-2f48b70e1b57-delete_volume" acquired by "delete_volume" :: waited 0.129s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:44:10 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-8c6bc5f5-bb91-4504-b995-61950320a725 req-bf461ec6-fa09-4315-965c-339f96fe0296 tempest-VolumesGetTestJSON-801496784 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:44:10 devstack cinder-volume[82800]: DEBUG cinder.coordination [req-8c6bc5f5-bb91-4504-b995-61950320a725 req-bf461ec6-fa09-4315-965c-339f96fe0296 tempest-VolumesGetTestJSON-801496784 None] Acquiring lock "cinder-quobyte-3b75ec01-18bb-4fec-883e-2f48b70e1b57" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:44:10 devstack cinder-volume[82800]: DEBUG cinder.coordination [req-8c6bc5f5-bb91-4504-b995-61950320a725 req-bf461ec6-fa09-4315-965c-339f96fe0296 tempest-VolumesGetTestJSON-801496784 None] Lock "cinder-quobyte-3b75ec01-18bb-4fec-883e-2f48b70e1b57" acquired by "delete_volume" :: waited 0.023s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:44:10 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37afa13-ad30-4c88-87da-47447bf52cc9]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:44:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-8c6bc5f5-bb91-4504-b995-61950320a725 req-bf461ec6-fa09-4315-965c-339f96fe0296 tempest-VolumesGetTestJSON-801496784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3b75ec01-18bb-4fec-883e-2f48b70e1b57 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:44:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-8c6bc5f5-bb91-4504-b995-61950320a725 req-bf461ec6-fa09-4315-965c-339f96fe0296 tempest-VolumesGetTestJSON-801496784 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3b75ec01-18bb-4fec-883e-2f48b70e1b57" returned: 0 in 0.721s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:44:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-8c6bc5f5-bb91-4504-b995-61950320a725 req-bf461ec6-fa09-4315-965c-339f96fe0296 tempest-VolumesGetTestJSON-801496784 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3b75ec01-18bb-4fec-883e-2f48b70e1b57 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:44:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-8c6bc5f5-bb91-4504-b995-61950320a725 req-bf461ec6-fa09-4315-965c-339f96fe0296 tempest-VolumesGetTestJSON-801496784 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3b75ec01-18bb-4fec-883e-2f48b70e1b57" returned: 0 in 0.249s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:44:11 devstack cinder-volume[82800]: DEBUG cinder.coordination [req-8c6bc5f5-bb91-4504-b995-61950320a725 req-bf461ec6-fa09-4315-965c-339f96fe0296 tempest-VolumesGetTestJSON-801496784 None] Lock "cinder-quobyte-3b75ec01-18bb-4fec-883e-2f48b70e1b57" released by "delete_volume" :: held 1.407s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:44:12 devstack cinder-volume[82800]: DEBUG cinder.quota [req-8c6bc5f5-bb91-4504-b995-61950320a725 req-bf461ec6-fa09-4315-965c-339f96fe0296 tempest-VolumesGetTestJSON-801496784 None] Created reservations ['dc5ca38f-76c9-479f-9ac8-c23e12b2556c', '0244cb0b-e96a-4bba-b994-5ba9560b432f', '0653ddaa-0d1e-4bf5-9861-146b292cac0d', 'd6e4db60-93af-42ee-8260-6c676598948e'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:44:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-8c6bc5f5-bb91-4504-b995-61950320a725 req-bf461ec6-fa09-4315-965c-339f96fe0296 tempest-VolumesGetTestJSON-801496784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:44:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-8c6bc5f5-bb91-4504-b995-61950320a725 req-bf461ec6-fa09-4315-965c-339f96fe0296 tempest-VolumesGetTestJSON-801496784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:44:12 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [req-8c6bc5f5-bb91-4504-b995-61950320a725 req-bf461ec6-fa09-4315-965c-339f96fe0296 tempest-VolumesGetTestJSON-801496784 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:44:12 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [req-8c6bc5f5-bb91-4504-b995-61950320a725 req-bf461ec6-fa09-4315-965c-339f96fe0296 tempest-VolumesGetTestJSON-801496784 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:44:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-8c6bc5f5-bb91-4504-b995-61950320a725 req-bf461ec6-fa09-4315-965c-339f96fe0296 tempest-VolumesGetTestJSON-801496784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:44:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-8c6bc5f5-bb91-4504-b995-61950320a725 req-bf461ec6-fa09-4315-965c-339f96fe0296 tempest-VolumesGetTestJSON-801496784 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:44:13 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-8c6bc5f5-bb91-4504-b995-61950320a725 req-bf461ec6-fa09-4315-965c-339f96fe0296 tempest-VolumesGetTestJSON-801496784 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.269s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:44:13 devstack cinder-volume[82800]: DEBUG cinder.manager [req-8c6bc5f5-bb91-4504-b995-61950320a725 req-bf461ec6-fa09-4315-965c-339f96fe0296 tempest-VolumesGetTestJSON-801496784 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:44:13 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-8c6bc5f5-bb91-4504-b995-61950320a725 req-bf461ec6-fa09-4315-965c-339f96fe0296 tempest-VolumesGetTestJSON-801496784 None] Deleted volume successfully. Sep 10 15:44:13 devstack cinder-volume[82800]: DEBUG cinder.coordination [req-8c6bc5f5-bb91-4504-b995-61950320a725 req-bf461ec6-fa09-4315-965c-339f96fe0296 tempest-VolumesGetTestJSON-801496784 None] Lock "cinder-3b75ec01-18bb-4fec-883e-2f48b70e1b57-delete_volume" released by "delete_volume" :: held 3.559s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:44:22 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=11,cinder:DELETE=1,cinder:SELECT=5,cinder:INSERT=4 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:44:23 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:44:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:44:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:44:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:44:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:44:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:44:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.069s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:44:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:44:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.358s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:44:30 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:44:35 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:44:35 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:44:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Flow 'volume_create_manager' (b8ba35a7-e85a-4249-918b-128468803e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:44:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410ab496-3368-4749-a036-f8188f73840d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410ab496-3368-4749-a036-f8188f73840d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1878411193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8345996-c653-4a8e-a171-c6f48a123373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6569f561c3d24e7cb279977a5d0a33fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:44:35Z,use_quota=True,user_id='11608912c9ca4171a3910eafd523ce98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3cdd8ad-9fa3-42e5-a297-f1f01f3ed492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3cdd8ad-9fa3-42e5-a297-f1f01f3ed492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aebde03-ff85-40cf-99af-ed6d095f4aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aebde03-ff85-40cf-99af-ed6d095f4aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8345996-c653-4a8e-a171-c6f48a123373', 'volume_name': 'volume-c8345996-c653-4a8e-a171-c6f48a123373', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (041e885a-6bea-4e11-8e57-a172424cff9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (041e885a-6bea-4e11-8e57-a172424cff9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03fc2996-7a3f-42a4-8075-af9c12488a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:35 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Volume c8345996-c653-4a8e-a171-c6f48a123373: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8345996-c653-4a8e-a171-c6f48a123373', 'volume_size': 1} Sep 10 15:44:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:44:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:44:35 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1878411193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8345996-c653-4a8e-a171-c6f48a123373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6569f561c3d24e7cb279977a5d0a33fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:44:35Z,use_quota=True,user_id='11608912c9ca4171a3910eafd523ce98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:44:35 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Creating volume c8345996-c653-4a8e-a171-c6f48a123373 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:44:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:44:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:44:35 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:44:35 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:44:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:44:35 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:44:35 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:44:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c8345996-c653-4a8e-a171-c6f48a123373 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:44:36 devstack quobyte-client[82814]: System call of process 95341 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:44:36 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=91, name=volume-c8345996-c653-4a8e-a171-c6f48a123373, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:44:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c8345996-c653-4a8e-a171-c6f48a123373 1073741824" returned: 0 in 0.692s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:44:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c8345996-c653-4a8e-a171-c6f48a123373 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:44:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c8345996-c653-4a8e-a171-c6f48a123373" returned: 0 in 0.204s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:44:37 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] <== create_volume: return (1218ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:44:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:44:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03fc2996-7a3f-42a4-8075-af9c12488a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8345996-c653-4a8e-a171-c6f48a123373', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ec183e-a3a4-439c-8852-94583f19f8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:38 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Volume volume-c8345996-c653-4a8e-a171-c6f48a123373 (c8345996-c653-4a8e-a171-c6f48a123373): created successfully Sep 10 15:44:38 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ec183e-a3a4-439c-8852-94583f19f8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:38 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Flow 'volume_create_manager' (b8ba35a7-e85a-4249-918b-128468803e24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:44:38 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-421dcead-13a0-4dca-b1e3-14278d86e752 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Created volume successfully. Sep 10 15:44:42 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ecdf0403-6ff7-4a87-8e84-d7db62eb66b4 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Acquiring lock "cinder-c8345996-c653-4a8e-a171-c6f48a123373-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:44:42 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ecdf0403-6ff7-4a87-8e84-d7db62eb66b4 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Lock "cinder-c8345996-c653-4a8e-a171-c6f48a123373-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:44:42 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-ecdf0403-6ff7-4a87-8e84-d7db62eb66b4 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:44:42 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ecdf0403-6ff7-4a87-8e84-d7db62eb66b4 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Acquiring lock "cinder-quobyte-c8345996-c653-4a8e-a171-c6f48a123373" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:44:42 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ecdf0403-6ff7-4a87-8e84-d7db62eb66b4 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Lock "cinder-quobyte-c8345996-c653-4a8e-a171-c6f48a123373" acquired by "delete_volume" :: waited 0.012s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:44:42 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c344278-3b62-4e40-9b6e-3e317f33cb54]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:44:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ecdf0403-6ff7-4a87-8e84-d7db62eb66b4 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c8345996-c653-4a8e-a171-c6f48a123373 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:44:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ecdf0403-6ff7-4a87-8e84-d7db62eb66b4 tempest-VolumeQuotasNegativeTestJSON-576330419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c8345996-c653-4a8e-a171-c6f48a123373" returned: 0 in 0.969s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:44:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ecdf0403-6ff7-4a87-8e84-d7db62eb66b4 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c8345996-c653-4a8e-a171-c6f48a123373 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:44:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ecdf0403-6ff7-4a87-8e84-d7db62eb66b4 tempest-VolumeQuotasNegativeTestJSON-576330419 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c8345996-c653-4a8e-a171-c6f48a123373" returned: 0 in 0.326s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:44:44 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ecdf0403-6ff7-4a87-8e84-d7db62eb66b4 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Lock "cinder-quobyte-c8345996-c653-4a8e-a171-c6f48a123373" released by "delete_volume" :: held 1.538s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:44:44 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-ecdf0403-6ff7-4a87-8e84-d7db62eb66b4 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Created reservations ['d8ca6d35-b784-44e3-8366-e494acefe7a4', '17dbd4ba-508a-4fcb-8826-1ffeca8f6860', '26e1efbd-93c5-4919-bb9e-fe1a57b785bd', '1d37ef8a-4f2b-44c8-b5ca-5630d872ef8f'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:44:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ecdf0403-6ff7-4a87-8e84-d7db62eb66b4 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:44:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ecdf0403-6ff7-4a87-8e84-d7db62eb66b4 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:44:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-ecdf0403-6ff7-4a87-8e84-d7db62eb66b4 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:44:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-ecdf0403-6ff7-4a87-8e84-d7db62eb66b4 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:44:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ecdf0403-6ff7-4a87-8e84-d7db62eb66b4 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:44:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ecdf0403-6ff7-4a87-8e84-d7db62eb66b4 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:44:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ecdf0403-6ff7-4a87-8e84-d7db62eb66b4 tempest-VolumeQuotasNegativeTestJSON-576330419 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.238s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:44:45 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-ecdf0403-6ff7-4a87-8e84-d7db62eb66b4 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:44:45 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-ecdf0403-6ff7-4a87-8e84-d7db62eb66b4 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Deleted volume successfully. Sep 10 15:44:45 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ecdf0403-6ff7-4a87-8e84-d7db62eb66b4 tempest-VolumeQuotasNegativeTestJSON-576330419 None] Lock "cinder-c8345996-c653-4a8e-a171-c6f48a123373-delete_volume" released by "delete_volume" :: held 3.363s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:44:49 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:44:49 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:44:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Flow 'volume_create_manager' (48d19271-9062-4fd9-ba6c-23ad79b31964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:44:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135923ea-ec8d-4e29-a87b-25a81a9af88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135923ea-ec8d-4e29-a87b-25a81a9af88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-182420015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86529936-cf4f-4c8a-b23e-1dd294743745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='251494a3b26941f58ac4f2d42d90f00a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:44:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:44:49Z,use_quota=True,user_id='7be8b14bb6a049b5925aa42210f271c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ac908e-0cd9-434f-a995-7ffb829152f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ac908e-0cd9-434f-a995-7ffb829152f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82858b4c-44e1-4892-afc2-5a0c8ca99048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82858b4c-44e1-4892-afc2-5a0c8ca99048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86529936-cf4f-4c8a-b23e-1dd294743745', 'volume_name': 'volume-86529936-cf4f-4c8a-b23e-1dd294743745', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97953671-0e4d-44f8-9437-70b453c29c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97953671-0e4d-44f8-9437-70b453c29c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (121799a8-f3b7-499e-89a4-d4166c550522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:49 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Volume 86529936-cf4f-4c8a-b23e-1dd294743745: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86529936-cf4f-4c8a-b23e-1dd294743745', 'volume_size': 1} Sep 10 15:44:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:44:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:44:49 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-182420015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86529936-cf4f-4c8a-b23e-1dd294743745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='251494a3b26941f58ac4f2d42d90f00a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:44:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:44:49Z,use_quota=True,user_id='7be8b14bb6a049b5925aa42210f271c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:44:49 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Creating volume 86529936-cf4f-4c8a-b23e-1dd294743745 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:44:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:44:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:44:49 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:44:49 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:44:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:44:49 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:44:49 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:44:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86529936-cf4f-4c8a-b23e-1dd294743745 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:44:50 devstack quobyte-client[82814]: System call of process 95386 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:44:50 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=92, name=volume-86529936-cf4f-4c8a-b23e-1dd294743745, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:44:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86529936-cf4f-4c8a-b23e-1dd294743745 1073741824" returned: 0 in 0.678s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:44:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86529936-cf4f-4c8a-b23e-1dd294743745 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:44:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86529936-cf4f-4c8a-b23e-1dd294743745" returned: 0 in 0.793s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:44:51 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] <== create_volume: return (1678ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:44:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:44:51 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:44:51 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:44:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Flow 'volume_create_manager' (a31a0f63-bbf3-4aa4-b4aa-cb4dba2642c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:44:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e124935b-2a0a-436f-bfb6-34108bd3d09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (121799a8-f3b7-499e-89a4-d4166c550522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86529936-cf4f-4c8a-b23e-1dd294743745', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f395eec8-9419-4523-a716-0903374eb044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e124935b-2a0a-436f-bfb6-34108bd3d09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1602479127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a330be-3bf3-4879-a586-c268af018a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='251494a3b26941f58ac4f2d42d90f00a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:44:51Z,use_quota=True,user_id='7be8b14bb6a049b5925aa42210f271c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c158fdc-3915-4472-a35d-b8a397cbe098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c158fdc-3915-4472-a35d-b8a397cbe098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713ee430-31e5-4897-9e87-50b9d540fb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (713ee430-31e5-4897-9e87-50b9d540fb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25a330be-3bf3-4879-a586-c268af018a59', 'volume_name': 'volume-25a330be-3bf3-4879-a586-c268af018a59', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a6e55bc-6161-4a49-a1c8-5caee9cbec8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a6e55bc-6161-4a49-a1c8-5caee9cbec8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18eb5ec-1892-4b47-b7cf-8bb90f2fa1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:52 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Volume 25a330be-3bf3-4879-a586-c268af018a59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25a330be-3bf3-4879-a586-c268af018a59', 'volume_size': 1} Sep 10 15:44:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:44:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:44:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1602479127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a330be-3bf3-4879-a586-c268af018a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='251494a3b26941f58ac4f2d42d90f00a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:44:51Z,use_quota=True,user_id='7be8b14bb6a049b5925aa42210f271c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:44:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Creating volume 25a330be-3bf3-4879-a586-c268af018a59 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:44:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:44:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:44:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:44:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:44:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:44:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:44:52 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:44:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-25a330be-3bf3-4879-a586-c268af018a59 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:44:52 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=93, name=volume-25a330be-3bf3-4879-a586-c268af018a59, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:44:52 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Volume volume-86529936-cf4f-4c8a-b23e-1dd294743745 (86529936-cf4f-4c8a-b23e-1dd294743745): created successfully Sep 10 15:44:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f395eec8-9419-4523-a716-0903374eb044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Flow 'volume_create_manager' (48d19271-9062-4fd9-ba6c-23ad79b31964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:44:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-25a330be-3bf3-4879-a586-c268af018a59 1073741824" returned: 0 in 0.852s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:44:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-25a330be-3bf3-4879-a586-c268af018a59 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:44:53 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-c51bf8d9-af7e-4db6-805e-985963c932c4 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Created volume successfully. Sep 10 15:44:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-25a330be-3bf3-4879-a586-c268af018a59" returned: 0 in 0.369s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:44:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] <== create_volume: return (1255ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:44:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:44:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18eb5ec-1892-4b47-b7cf-8bb90f2fa1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25a330be-3bf3-4879-a586-c268af018a59', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124ddc5e-f502-48ce-a626-3204f11bc8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:53 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Volume volume-25a330be-3bf3-4879-a586-c268af018a59 (25a330be-3bf3-4879-a586-c268af018a59): created successfully Sep 10 15:44:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124ddc5e-f502-48ce-a626-3204f11bc8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Flow 'volume_create_manager' (a31a0f63-bbf3-4aa4-b4aa-cb4dba2642c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:44:53 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-8a2bc489-d8ab-4a5f-94dc-9092d2515e50 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Created volume successfully. Sep 10 15:44:56 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:44:56 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:44:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Flow 'volume_create_manager' (a14b2ea1-a514-4796-a9e4-91df908c3edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:44:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a366e813-1d41-44e1-abe5-1b8c53012d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a366e813-1d41-44e1-abe5-1b8c53012d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1155211836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=166a9166-257d-422f-94ed-7322654bf015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9c97a7d16024ebcb12f6fefc58ee8d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:44:57Z,use_quota=True,user_id='d29343905bb041d183622a1a89f65f5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (672eeae3-37be-4f74-96ce-66ab2b598389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (672eeae3-37be-4f74-96ce-66ab2b598389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21aca6f-515a-40d0-81ac-43d4dfec3f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21aca6f-515a-40d0-81ac-43d4dfec3f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '166a9166-257d-422f-94ed-7322654bf015', 'volume_name': 'volume-166a9166-257d-422f-94ed-7322654bf015', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e1a64e-7a75-4108-b240-d502fb6182e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e1a64e-7a75-4108-b240-d502fb6182e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (662136de-2a77-4956-ad77-2ba72668496b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:56 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Volume 166a9166-257d-422f-94ed-7322654bf015: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-166a9166-257d-422f-94ed-7322654bf015', 'volume_size': 1} Sep 10 15:44:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:44:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:44:56 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1155211836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=166a9166-257d-422f-94ed-7322654bf015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9c97a7d16024ebcb12f6fefc58ee8d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:44:57Z,use_quota=True,user_id='d29343905bb041d183622a1a89f65f5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:44:56 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Creating volume 166a9166-257d-422f-94ed-7322654bf015 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:44:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:44:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:44:56 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:44:56 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:44:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:44:56 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:44:56 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:44:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-166a9166-257d-422f-94ed-7322654bf015 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:44:57 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=94, name=volume-166a9166-257d-422f-94ed-7322654bf015, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:44:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-166a9166-257d-422f-94ed-7322654bf015 1073741824" returned: 0 in 0.695s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:44:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-166a9166-257d-422f-94ed-7322654bf015 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:44:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-166a9166-257d-422f-94ed-7322654bf015" returned: 0 in 0.115s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:44:57 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] <== create_volume: return (914ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:44:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:44:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (662136de-2a77-4956-ad77-2ba72668496b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-166a9166-257d-422f-94ed-7322654bf015', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aacba530-4094-4060-bdd7-455e87ffce42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:44:58 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Volume volume-166a9166-257d-422f-94ed-7322654bf015 (166a9166-257d-422f-94ed-7322654bf015): created successfully Sep 10 15:44:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aacba530-4094-4060-bdd7-455e87ffce42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:44:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Flow 'volume_create_manager' (a14b2ea1-a514-4796-a9e4-91df908c3edf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:44:58 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-57a2f71f-9cf9-4c41-bd55-7774dc12510d tempest-VolumesServicesTestJSON-1855073361 None] Created volume successfully. Sep 10 15:44:59 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-23989c5a-913f-4ffd-b2d2-ab2fbca9c24c tempest-VolumesServicesTestJSON-1855073361 None] Acquiring lock "cinder-166a9166-257d-422f-94ed-7322654bf015-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:44:59 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-23989c5a-913f-4ffd-b2d2-ab2fbca9c24c tempest-VolumesServicesTestJSON-1855073361 None] Lock "cinder-166a9166-257d-422f-94ed-7322654bf015-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:44:59 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-23989c5a-913f-4ffd-b2d2-ab2fbca9c24c tempest-VolumesServicesTestJSON-1855073361 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:44:59 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-23989c5a-913f-4ffd-b2d2-ab2fbca9c24c tempest-VolumesServicesTestJSON-1855073361 None] Acquiring lock "cinder-quobyte-166a9166-257d-422f-94ed-7322654bf015" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:44:59 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-23989c5a-913f-4ffd-b2d2-ab2fbca9c24c tempest-VolumesServicesTestJSON-1855073361 None] Lock "cinder-quobyte-166a9166-257d-422f-94ed-7322654bf015" acquired by "delete_volume" :: waited 0.021s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:44:59 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d628fc-a29a-42c3-aee0-5edfec050a80]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:44:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-23989c5a-913f-4ffd-b2d2-ab2fbca9c24c tempest-VolumesServicesTestJSON-1855073361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-166a9166-257d-422f-94ed-7322654bf015 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:45:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-23989c5a-913f-4ffd-b2d2-ab2fbca9c24c tempest-VolumesServicesTestJSON-1855073361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-166a9166-257d-422f-94ed-7322654bf015" returned: 0 in 0.532s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:45:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-23989c5a-913f-4ffd-b2d2-ab2fbca9c24c tempest-VolumesServicesTestJSON-1855073361 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-166a9166-257d-422f-94ed-7322654bf015 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:45:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-23989c5a-913f-4ffd-b2d2-ab2fbca9c24c tempest-VolumesServicesTestJSON-1855073361 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-166a9166-257d-422f-94ed-7322654bf015" returned: 0 in 0.116s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:45:00 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-23989c5a-913f-4ffd-b2d2-ab2fbca9c24c tempest-VolumesServicesTestJSON-1855073361 None] Lock "cinder-quobyte-166a9166-257d-422f-94ed-7322654bf015" released by "delete_volume" :: held 0.835s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:45:00 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-23989c5a-913f-4ffd-b2d2-ab2fbca9c24c tempest-VolumesServicesTestJSON-1855073361 None] Created reservations ['416b961a-94da-42d7-acb8-5524f45823e6', '5b8417e3-008a-4291-a44d-c3e66f5a0551', '93952d19-a940-43c0-b41f-801387b89f16', '2e3a9fec-10cb-49ff-87c6-39234ed19b88'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:45:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-23989c5a-913f-4ffd-b2d2-ab2fbca9c24c tempest-VolumesServicesTestJSON-1855073361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:45:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-23989c5a-913f-4ffd-b2d2-ab2fbca9c24c tempest-VolumesServicesTestJSON-1855073361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:45:00 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-23989c5a-913f-4ffd-b2d2-ab2fbca9c24c tempest-VolumesServicesTestJSON-1855073361 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:45:00 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-23989c5a-913f-4ffd-b2d2-ab2fbca9c24c tempest-VolumesServicesTestJSON-1855073361 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:45:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-23989c5a-913f-4ffd-b2d2-ab2fbca9c24c tempest-VolumesServicesTestJSON-1855073361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:45:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-23989c5a-913f-4ffd-b2d2-ab2fbca9c24c tempest-VolumesServicesTestJSON-1855073361 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:45:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-23989c5a-913f-4ffd-b2d2-ab2fbca9c24c tempest-VolumesServicesTestJSON-1855073361 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.129s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:45:01 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-23989c5a-913f-4ffd-b2d2-ab2fbca9c24c tempest-VolumesServicesTestJSON-1855073361 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:45:01 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-23989c5a-913f-4ffd-b2d2-ab2fbca9c24c tempest-VolumesServicesTestJSON-1855073361 None] Deleted volume successfully. Sep 10 15:45:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-23989c5a-913f-4ffd-b2d2-ab2fbca9c24c tempest-VolumesServicesTestJSON-1855073361 None] Lock "cinder-166a9166-257d-422f-94ed-7322654bf015-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:45:10 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=14,cinder:DELETE=4,cinder:UPDATE=22,cinder:INSERT=4 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:45:11 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=27,cinder:SELECT=15,cinder:DELETE=2,cinder:INSERT=4 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:45:11 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:45:11 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:45:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Flow 'volume_create_manager' (cddaa776-a3c0-4fd3-8413-d570267bf2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:45:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ce93bc2-acaf-4790-9ec2-37c89a7b160c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:45:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ce93bc2-acaf-4790-9ec2-37c89a7b160c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1436185046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85cc06f9-f668-482a-ae4d-fa3aac9f945c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8878482a78c4448094c6b4c75f220d09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:45:12Z,use_quota=True,user_id='fc5412210f9f466e9cfe10701fbf698b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:45:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46545850-4a82-4153-a923-3cae4b320adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:45:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46545850-4a82-4153-a923-3cae4b320adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:45:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c8d5cd2-5bcf-462a-b39c-808de5911a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:45:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c8d5cd2-5bcf-462a-b39c-808de5911a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85cc06f9-f668-482a-ae4d-fa3aac9f945c', 'volume_name': 'volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:45:12 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbcc7d9b-62da-4d0e-82f9-66efc3ee5fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:45:12 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbcc7d9b-62da-4d0e-82f9-66efc3ee5fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:45:12 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9f34b8-2bea-4b2d-bbc3-e09db7ae8540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:45:12 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Volume 85cc06f9-f668-482a-ae4d-fa3aac9f945c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c', 'volume_size': 1} Sep 10 15:45:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:45:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:45:12 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1436185046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85cc06f9-f668-482a-ae4d-fa3aac9f945c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8878482a78c4448094c6b4c75f220d09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:45:12Z,use_quota=True,user_id='fc5412210f9f466e9cfe10701fbf698b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:45:12 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Creating volume 85cc06f9-f668-482a-ae4d-fa3aac9f945c {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:45:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:45:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:45:12 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:45:12 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:45:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:45:12 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:45:12 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:45:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:45:12 devstack quobyte-client[82814]: System call of process 95464 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:45:12 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=95, name=volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:45:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c 1073741824" returned: 0 in 0.478s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:45:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:45:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c" returned: 0 in 0.190s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:45:12 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] <== create_volume: return (892ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:45:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:45:13 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9f34b8-2bea-4b2d-bbc3-e09db7ae8540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:45:13 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a60807-fa7c-41a7-b0a2-625a14b8446d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:45:13 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Volume volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c (85cc06f9-f668-482a-ae4d-fa3aac9f945c): created successfully Sep 10 15:45:13 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a60807-fa7c-41a7-b0a2-625a14b8446d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:45:13 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Flow 'volume_create_manager' (cddaa776-a3c0-4fd3-8413-d570267bf2fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:45:13 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-30b12733-4562-4076-8ab6-d04c850909a1 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Created volume successfully. Sep 10 15:45:14 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-b49bd362-2f19-4e15-9085-3679e313ac3b tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:45:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b49bd362-2f19-4e15-9085-3679e313ac3b tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:45:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b49bd362-2f19-4e15-9085-3679e313ac3b tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:45:14 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-b49bd362-2f19-4e15-9085-3679e313ac3b tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Creating offline snapshot 5517c6ff-26f1-43fe-a082-3e4fea887d96 of volume 85cc06f9-f668-482a-ae4d-fa3aac9f945c {{(pid=82800) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 15:45:14 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4efea8a-274a-4162-a07f-c419613cbaef]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:45:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b49bd362-2f19-4e15-9085-3679e313ac3b tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:45:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b49bd362-2f19-4e15-9085-3679e313ac3b tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c" returned: 0 in 0.571s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:45:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b49bd362-2f19-4e15-9085-3679e313ac3b tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c.5517c6ff-26f1-43fe-a082-3e4fea887d96 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:45:15 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=96, name=volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c.5517c6ff-26f1-43fe-a082-3e4fea887d96, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:45:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b49bd362-2f19-4e15-9085-3679e313ac3b tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c.5517c6ff-26f1-43fe-a082-3e4fea887d96 1G" returned: 0 in 0.257s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:45:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b49bd362-2f19-4e15-9085-3679e313ac3b tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Running cmd (subprocess): qemu-img rebase -u -b volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c.5517c6ff-26f1-43fe-a082-3e4fea887d96 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:45:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b49bd362-2f19-4e15-9085-3679e313ac3b tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] CMD "qemu-img rebase -u -b volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c.5517c6ff-26f1-43fe-a082-3e4fea887d96" returned: 0 in 0.204s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:45:15 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-b49bd362-2f19-4e15-9085-3679e313ac3b tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c.5517c6ff-26f1-43fe-a082-3e4fea887d96 is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:45:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b49bd362-2f19-4e15-9085-3679e313ac3b tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c.5517c6ff-26f1-43fe-a082-3e4fea887d96 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:45:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b49bd362-2f19-4e15-9085-3679e313ac3b tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c.5517c6ff-26f1-43fe-a082-3e4fea887d96" returned: 0 in 0.105s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:45:15 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-b49bd362-2f19-4e15-9085-3679e313ac3b tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Setting permissions: /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c -> 1000:1000 {{(pid=82800) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 15:45:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b49bd362-2f19-4e15-9085-3679e313ac3b tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c.5517c6ff-26f1-43fe-a082-3e4fea887d96 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:45:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b49bd362-2f19-4e15-9085-3679e313ac3b tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c.5517c6ff-26f1-43fe-a082-3e4fea887d96" returned: 0 in 0.081s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:45:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b49bd362-2f19-4e15-9085-3679e313ac3b tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:45:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b49bd362-2f19-4e15-9085-3679e313ac3b tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c.info" returned: 0 in 0.119s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:45:16 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-b49bd362-2f19-4e15-9085-3679e313ac3b tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c.info is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:45:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b49bd362-2f19-4e15-9085-3679e313ac3b tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:45:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b49bd362-2f19-4e15-9085-3679e313ac3b tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c.info" returned: 0 in 0.171s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:45:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b49bd362-2f19-4e15-9085-3679e313ac3b tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.985s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:45:16 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-b49bd362-2f19-4e15-9085-3679e313ac3b tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Create snapshot completed successfully Sep 10 15:45:18 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-2b11543f-caf5-4e17-b66d-2ff8313edd42 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Acquiring lock "cinder-5517c6ff-26f1-43fe-a082-3e4fea887d96-delete_snapshot" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:45:18 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-2b11543f-caf5-4e17-b66d-2ff8313edd42 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Lock "cinder-5517c6ff-26f1-43fe-a082-3e4fea887d96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.131s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:45:18 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-2b11543f-caf5-4e17-b66d-2ff8313edd42 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:45:18 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-2b11543f-caf5-4e17-b66d-2ff8313edd42 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Acquiring lock "cinder-quobyte-85cc06f9-f668-482a-ae4d-fa3aac9f945c" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:45:18 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-2b11543f-caf5-4e17-b66d-2ff8313edd42 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Lock "cinder-quobyte-85cc06f9-f668-482a-ae4d-fa3aac9f945c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:45:18 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-2b11543f-caf5-4e17-b66d-2ff8313edd42 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Acquiring lock "cinder-quobyte-5517c6ff-26f1-43fe-a082-3e4fea887d96" by "_delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:45:18 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-2b11543f-caf5-4e17-b66d-2ff8313edd42 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Lock "cinder-quobyte-5517c6ff-26f1-43fe-a082-3e4fea887d96" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:45:18 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-2b11543f-caf5-4e17-b66d-2ff8313edd42 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Deleting offline snapshot 5517c6ff-26f1-43fe-a082-3e4fea887d96 of volume 85cc06f9-f668-482a-ae4d-fa3aac9f945c {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 15:45:18 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-2b11543f-caf5-4e17-b66d-2ff8313edd42 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] snapshot_file for this snap is: volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c.5517c6ff-26f1-43fe-a082-3e4fea887d96 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 15:45:18 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b574687-675a-451c-a0d1-9a050fff6725]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:45:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2b11543f-caf5-4e17-b66d-2ff8313edd42 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c.5517c6ff-26f1-43fe-a082-3e4fea887d96 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:45:19 devstack quobyte-client[82814]: System call of process 95493 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:45:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2b11543f-caf5-4e17-b66d-2ff8313edd42 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c.5517c6ff-26f1-43fe-a082-3e4fea887d96" returned: 0 in 0.623s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:45:19 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-2b11543f-caf5-4e17-b66d-2ff8313edd42 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:45:19 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[014969db-38ec-40c0-8e94-3d52ffba23e5]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:45:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2b11543f-caf5-4e17-b66d-2ff8313edd42 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:45:20 devstack quobyte-client[82814]: System call of process 95502 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:45:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2b11543f-caf5-4e17-b66d-2ff8313edd42 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c" returned: 0 in 0.947s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:45:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2b11543f-caf5-4e17-b66d-2ff8313edd42 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c.5517c6ff-26f1-43fe-a082-3e4fea887d96 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:45:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2b11543f-caf5-4e17-b66d-2ff8313edd42 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c.5517c6ff-26f1-43fe-a082-3e4fea887d96" returned: 0 in 0.453s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:45:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2b11543f-caf5-4e17-b66d-2ff8313edd42 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c.5517c6ff-26f1-43fe-a082-3e4fea887d96 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:45:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2b11543f-caf5-4e17-b66d-2ff8313edd42 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c.5517c6ff-26f1-43fe-a082-3e4fea887d96" returned: 0 in 0.152s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:45:21 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-2b11543f-caf5-4e17-b66d-2ff8313edd42 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Lock "cinder-quobyte-5517c6ff-26f1-43fe-a082-3e4fea887d96" released by "_delete_snapshot" :: held 2.696s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:45:21 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-2b11543f-caf5-4e17-b66d-2ff8313edd42 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Lock "cinder-quobyte-85cc06f9-f668-482a-ae4d-fa3aac9f945c" released by "delete_snapshot" :: held 2.749s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:45:22 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-2b11543f-caf5-4e17-b66d-2ff8313edd42 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Created reservations ['528cb83b-9751-4ac9-b374-3a9caf2436b3', '7f5412d5-0903-40ad-917d-2a43ff250cc0', 'd57444f2-9a13-4226-be4c-ec1557452c40', 'e82c67ed-b10e-4cab-9fb5-6a7b008d5392'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:45:22 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-2b11543f-caf5-4e17-b66d-2ff8313edd42 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Delete snapshot completed successfully. Sep 10 15:45:22 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-2b11543f-caf5-4e17-b66d-2ff8313edd42 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Lock "cinder-5517c6ff-26f1-43fe-a082-3e4fea887d96-delete_snapshot" released by "delete_snapshot" :: held 4.454s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:45:23 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-8726a1f7-e2c9-430f-932b-27b4a0d63fe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Acquiring lock "cinder-85cc06f9-f668-482a-ae4d-fa3aac9f945c-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:45:23 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-8726a1f7-e2c9-430f-932b-27b4a0d63fe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Lock "cinder-85cc06f9-f668-482a-ae4d-fa3aac9f945c-delete_volume" acquired by "delete_volume" :: waited 0.149s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:45:23 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-8726a1f7-e2c9-430f-932b-27b4a0d63fe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:45:23 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-8726a1f7-e2c9-430f-932b-27b4a0d63fe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Acquiring lock "cinder-quobyte-85cc06f9-f668-482a-ae4d-fa3aac9f945c" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:45:23 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-8726a1f7-e2c9-430f-932b-27b4a0d63fe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Lock "cinder-quobyte-85cc06f9-f668-482a-ae4d-fa3aac9f945c" acquired by "delete_volume" :: waited 0.028s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:45:23 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[910b78e2-e2ef-48b5-bbf9-4f1f60faebfb]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:45:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8726a1f7-e2c9-430f-932b-27b4a0d63fe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:45:25 devstack quobyte-client[82814]: System call of process 95564 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:45:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8726a1f7-e2c9-430f-932b-27b4a0d63fe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c" returned: 0 in 1.712s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:45:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8726a1f7-e2c9-430f-932b-27b4a0d63fe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:45:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8726a1f7-e2c9-430f-932b-27b4a0d63fe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-85cc06f9-f668-482a-ae4d-fa3aac9f945c" returned: 0 in 0.262s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:45:26 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-8726a1f7-e2c9-430f-932b-27b4a0d63fe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Lock "cinder-quobyte-85cc06f9-f668-482a-ae4d-fa3aac9f945c" released by "delete_volume" :: held 2.401s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:45:26 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-8726a1f7-e2c9-430f-932b-27b4a0d63fe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Created reservations ['01c2d8c8-1e1a-4e83-8aea-a055526c3e8c', 'dbaf094c-644d-4157-b878-ee9426c3c93e', '24da93eb-d358-4a0a-8719-e333aa0b32fe', '3b20fa82-485e-46f6-ae65-d8584d50e9ef'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:45:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8726a1f7-e2c9-430f-932b-27b4a0d63fe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:45:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8726a1f7-e2c9-430f-932b-27b4a0d63fe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:45:27 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8726a1f7-e2c9-430f-932b-27b4a0d63fe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:45:27 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8726a1f7-e2c9-430f-932b-27b4a0d63fe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:45:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8726a1f7-e2c9-430f-932b-27b4a0d63fe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:45:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8726a1f7-e2c9-430f-932b-27b4a0d63fe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:45:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8726a1f7-e2c9-430f-932b-27b4a0d63fe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.271s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:45:27 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-8726a1f7-e2c9-430f-932b-27b4a0d63fe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:45:27 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-8726a1f7-e2c9-430f-932b-27b4a0d63fe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Deleted volume successfully. Sep 10 15:45:28 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-8726a1f7-e2c9-430f-932b-27b4a0d63fe7 tempest-VolumeSnapshotQuotasNegativeTestJSON-770181561 None] Lock "cinder-85cc06f9-f668-482a-ae4d-fa3aac9f945c-delete_volume" released by "delete_volume" :: held 5.001s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:45:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:45:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:45:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:45:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:45:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:45:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:45:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:45:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.515s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:45:30 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:45:37 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=11,cinder:UPDATE=16,cinder:DELETE=2,cinder:INSERT=8 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:45:38 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=17,cinder:SELECT=13,cinder:DELETE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:45:45 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:45:45 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:45:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Flow 'volume_create_manager' (d0e6e59e-a898-42cf-bab1-eb58665ff055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:45:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a920328e-24d6-4eff-8763-0a385afed7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:45:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a920328e-24d6-4eff-8763-0a385afed7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-827273970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22182ec3-ce65-4425-8165-93ee0c5e7312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7a82d23de3447748460dcc61983487c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:45:45Z,use_quota=True,user_id='31341c16dd8b464ea18acc678b9f4acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:45:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774fc720-ec3c-4734-9386-bc9ee61bcb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:45:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774fc720-ec3c-4734-9386-bc9ee61bcb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:45:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68656d52-d889-489a-aca9-24bb9649640b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:45:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68656d52-d889-489a-aca9-24bb9649640b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22182ec3-ce65-4425-8165-93ee0c5e7312', 'volume_name': 'volume-22182ec3-ce65-4425-8165-93ee0c5e7312', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:45:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f24ea2-62d9-4c8b-a4d8-8a5fc1585692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:45:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f24ea2-62d9-4c8b-a4d8-8a5fc1585692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:45:45 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1d263e-78b1-4ced-98a1-e1e4c1827c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:45:45 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Volume 22182ec3-ce65-4425-8165-93ee0c5e7312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22182ec3-ce65-4425-8165-93ee0c5e7312', 'volume_size': 1} Sep 10 15:45:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:45:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:45:45 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-827273970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22182ec3-ce65-4425-8165-93ee0c5e7312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7a82d23de3447748460dcc61983487c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:45:45Z,use_quota=True,user_id='31341c16dd8b464ea18acc678b9f4acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:45:45 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Creating volume 22182ec3-ce65-4425-8165-93ee0c5e7312 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:45:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:45:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:45:45 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:45:45 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:45:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:45:45 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:45:45 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:45:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-22182ec3-ce65-4425-8165-93ee0c5e7312 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:45:45 devstack quobyte-client[82814]: System call of process 95640 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:45:45 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=98, name=volume-22182ec3-ce65-4425-8165-93ee0c5e7312, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:45:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-22182ec3-ce65-4425-8165-93ee0c5e7312 1073741824" returned: 0 in 0.544s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:45:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-22182ec3-ce65-4425-8165-93ee0c5e7312 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:45:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-22182ec3-ce65-4425-8165-93ee0c5e7312" returned: 0 in 0.135s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:45:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] <== create_volume: return (764ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:45:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:45:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1d263e-78b1-4ced-98a1-e1e4c1827c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22182ec3-ce65-4425-8165-93ee0c5e7312', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:45:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd38ac4-0a70-4c38-a2bc-fd8839081d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:45:46 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Volume volume-22182ec3-ce65-4425-8165-93ee0c5e7312 (22182ec3-ce65-4425-8165-93ee0c5e7312): created successfully Sep 10 15:45:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd38ac4-0a70-4c38-a2bc-fd8839081d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:45:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Flow 'volume_create_manager' (d0e6e59e-a898-42cf-bab1-eb58665ff055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:45:46 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-7470de77-75ea-44f7-9c92-52ae5e08a326 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Created volume successfully. Sep 10 15:45:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-15440771-f921-43b4-9f42-45c0527e0a00 req-7db43147-3878-4689-bf0d-47a1497be641 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:45:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-15440771-f921-43b4-9f42-45c0527e0a00 req-7db43147-3878-4689-bf0d-47a1497be641 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:45:52 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fccb73-9d86-420a-abeb-5a0b54397419]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:45:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-15440771-f921-43b4-9f42-45c0527e0a00 req-7db43147-3878-4689-bf0d-47a1497be641 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-22182ec3-ce65-4425-8165-93ee0c5e7312 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:45:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-15440771-f921-43b4-9f42-45c0527e0a00 req-7db43147-3878-4689-bf0d-47a1497be641 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-22182ec3-ce65-4425-8165-93ee0c5e7312" returned: 0 in 0.809s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:45:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-15440771-f921-43b4-9f42-45c0527e0a00 req-7db43147-3878-4689-bf0d-47a1497be641 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.883s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:45:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-15440771-f921-43b4-9f42-45c0527e0a00 req-7db43147-3878-4689-bf0d-47a1497be641 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5', 'name': 'volume-22182ec3-ce65-4425-8165-93ee0c5e7312', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53d70ee0-78cd-482b-af1b-5bb95d433e45', 'enforce_multipath': True} {{(pid=82800) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 15:45:53 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-15440771-f921-43b4-9f42-45c0527e0a00 req-7db43147-3878-4689-bf0d-47a1497be641 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:45:54 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-15440771-f921-43b4-9f42-45c0527e0a00 req-7db43147-3878-4689-bf0d-47a1497be641 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] attachment_update completed successfully. Sep 10 15:46:04 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:46:04 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:46:27 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-38eb8420-73dc-4f6f-a3c5-5588068a0b8a req-4f6c2ebe-1144-4baa-a592-5112eb6b8999 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:46:27 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-38eb8420-73dc-4f6f-a3c5-5588068a0b8a req-4f6c2ebe-1144-4baa-a592-5112eb6b8999 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:46:27 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-38eb8420-73dc-4f6f-a3c5-5588068a0b8a req-4f6c2ebe-1144-4baa-a592-5112eb6b8999 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Terminate volume connection completed successfully. Sep 10 15:46:27 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-38eb8420-73dc-4f6f-a3c5-5588068a0b8a req-4f6c2ebe-1144-4baa-a592-5112eb6b8999 tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Deleting attachment 53d70ee0-78cd-482b-af1b-5bb95d433e45. {{(pid=82800) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 15:46:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:46:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:46:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:46:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:46:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:46:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:46:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:46:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.253s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:46:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:46:30 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c97d20d0-06d6-4a7f-9390-d7822c3af84e tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Acquiring lock "cinder-22182ec3-ce65-4425-8165-93ee0c5e7312-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:46:30 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c97d20d0-06d6-4a7f-9390-d7822c3af84e tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Lock "cinder-22182ec3-ce65-4425-8165-93ee0c5e7312-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:46:30 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-c97d20d0-06d6-4a7f-9390-d7822c3af84e tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:46:30 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c97d20d0-06d6-4a7f-9390-d7822c3af84e tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Acquiring lock "cinder-quobyte-22182ec3-ce65-4425-8165-93ee0c5e7312" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:46:30 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c97d20d0-06d6-4a7f-9390-d7822c3af84e tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Lock "cinder-quobyte-22182ec3-ce65-4425-8165-93ee0c5e7312" acquired by "delete_volume" :: waited 0.020s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:46:30 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ede9232-a2b6-4f61-b000-bd1d4db71a4e]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:46:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c97d20d0-06d6-4a7f-9390-d7822c3af84e tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-22182ec3-ce65-4425-8165-93ee0c5e7312 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:46:31 devstack quobyte-client[82814]: System call of process 96146 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:46:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c97d20d0-06d6-4a7f-9390-d7822c3af84e tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-22182ec3-ce65-4425-8165-93ee0c5e7312" returned: 0 in 0.611s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:46:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c97d20d0-06d6-4a7f-9390-d7822c3af84e tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-22182ec3-ce65-4425-8165-93ee0c5e7312 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:46:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c97d20d0-06d6-4a7f-9390-d7822c3af84e tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-22182ec3-ce65-4425-8165-93ee0c5e7312" returned: 0 in 0.311s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:46:31 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c97d20d0-06d6-4a7f-9390-d7822c3af84e tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Lock "cinder-quobyte-22182ec3-ce65-4425-8165-93ee0c5e7312" released by "delete_volume" :: held 1.267s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:46:32 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-c97d20d0-06d6-4a7f-9390-d7822c3af84e tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Created reservations ['170236a1-9902-4f8a-b1a9-ef3cef692b77', 'b65743c7-5c08-44ba-9390-da85ab04760a', '9aa6f42c-e22d-4a2c-8548-8d7168b1dc32', 'd763380f-c92f-467e-9bc2-a7a2a303a309'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:46:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c97d20d0-06d6-4a7f-9390-d7822c3af84e tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:46:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c97d20d0-06d6-4a7f-9390-d7822c3af84e tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:46:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c97d20d0-06d6-4a7f-9390-d7822c3af84e tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:46:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c97d20d0-06d6-4a7f-9390-d7822c3af84e tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:46:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c97d20d0-06d6-4a7f-9390-d7822c3af84e tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:46:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c97d20d0-06d6-4a7f-9390-d7822c3af84e tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:46:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c97d20d0-06d6-4a7f-9390-d7822c3af84e tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.202s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:46:33 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-c97d20d0-06d6-4a7f-9390-d7822c3af84e tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:46:33 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-c97d20d0-06d6-4a7f-9390-d7822c3af84e tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Deleted volume successfully. Sep 10 15:46:34 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c97d20d0-06d6-4a7f-9390-d7822c3af84e tempest-TestServerVolumeAttachScenarioOldVersion-660151372 None] Lock "cinder-22182ec3-ce65-4425-8165-93ee0c5e7312-delete_volume" released by "delete_volume" :: held 4.006s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:46:42 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=5 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:46:44 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=5,cinder:UPDATE=11,cinder:INSERT=3,cinder:DELETE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:46:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-eba70402-7e0d-4e5c-94dc-b52e684379bb req-6dc35c5c-8da7-43ee-966b-3dfc8ffd2da3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:46:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-eba70402-7e0d-4e5c-94dc-b52e684379bb req-6dc35c5c-8da7-43ee-966b-3dfc8ffd2da3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:46:45 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db4e6e8-f7b9-4b24-af95-bd670c01e1ea]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:46:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-eba70402-7e0d-4e5c-94dc-b52e684379bb req-6dc35c5c-8da7-43ee-966b-3dfc8ffd2da3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86529936-cf4f-4c8a-b23e-1dd294743745 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:46:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-eba70402-7e0d-4e5c-94dc-b52e684379bb req-6dc35c5c-8da7-43ee-966b-3dfc8ffd2da3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86529936-cf4f-4c8a-b23e-1dd294743745" returned: 0 in 0.720s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:46:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-eba70402-7e0d-4e5c-94dc-b52e684379bb req-6dc35c5c-8da7-43ee-966b-3dfc8ffd2da3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.801s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:46:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-eba70402-7e0d-4e5c-94dc-b52e684379bb req-6dc35c5c-8da7-43ee-966b-3dfc8ffd2da3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5', 'name': 'volume-86529936-cf4f-4c8a-b23e-1dd294743745', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29941e0a-706e-4450-b654-8c3d246b9bb1', 'enforce_multipath': True} {{(pid=82800) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 15:46:46 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-eba70402-7e0d-4e5c-94dc-b52e684379bb req-6dc35c5c-8da7-43ee-966b-3dfc8ffd2da3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:46:47 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-eba70402-7e0d-4e5c-94dc-b52e684379bb req-6dc35c5c-8da7-43ee-966b-3dfc8ffd2da3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] attachment_update completed successfully. Sep 10 15:46:57 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:46:57 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:47:00 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:00 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:47:00 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Flow 'volume_create_manager' (cebdee48-428d-446d-ba39-2fe85c8c4cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:47:00 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bccaf130-d5df-439e-80cd-21f8f5580eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:00 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bccaf130-d5df-439e-80cd-21f8f5580eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2057936146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3917ed27-e17b-4827-88d6-7c677f24359d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1f49282afc4150b10dceffb5d7f6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:47:00Z,use_quota=True,user_id='d677841be9b04ed081fb21d3fa8cf52e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:00 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36435a7d-2611-42ef-afc3-4ca5e9e5668e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:00 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36435a7d-2611-42ef-afc3-4ca5e9e5668e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:00 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526543d7-6fc0-46b8-b6ef-8e48aa87b426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:00 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526543d7-6fc0-46b8-b6ef-8e48aa87b426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3917ed27-e17b-4827-88d6-7c677f24359d', 'volume_name': 'volume-3917ed27-e17b-4827-88d6-7c677f24359d', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:00 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aecd726e-b527-4a3b-81b2-a0d3ba4f50d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:00 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aecd726e-b527-4a3b-81b2-a0d3ba4f50d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:00 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba66004-6920-4b1e-8265-e827fe00cb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:00 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Volume 3917ed27-e17b-4827-88d6-7c677f24359d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3917ed27-e17b-4827-88d6-7c677f24359d', 'volume_size': 1} Sep 10 15:47:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:00 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2057936146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3917ed27-e17b-4827-88d6-7c677f24359d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1f49282afc4150b10dceffb5d7f6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:47:00Z,use_quota=True,user_id='d677841be9b04ed081fb21d3fa8cf52e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:47:00 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Creating volume 3917ed27-e17b-4827-88d6-7c677f24359d {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:47:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:00 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:47:00 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:47:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:00 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:47:00 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:47:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3917ed27-e17b-4827-88d6-7c677f24359d 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:01 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=99, name=volume-3917ed27-e17b-4827-88d6-7c677f24359d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:47:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3917ed27-e17b-4827-88d6-7c677f24359d 1073741824" returned: 0 in 0.774s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3917ed27-e17b-4827-88d6-7c677f24359d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3917ed27-e17b-4827-88d6-7c677f24359d" returned: 0 in 0.127s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:01 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] <== create_volume: return (1021ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:47:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:02 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dba66004-6920-4b1e-8265-e827fe00cb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3917ed27-e17b-4827-88d6-7c677f24359d', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:02 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1195ae1a-aacc-4eb2-a00e-a324e7b80546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:02 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Volume volume-3917ed27-e17b-4827-88d6-7c677f24359d (3917ed27-e17b-4827-88d6-7c677f24359d): created successfully Sep 10 15:47:02 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1195ae1a-aacc-4eb2-a00e-a324e7b80546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:02 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Flow 'volume_create_manager' (cebdee48-428d-446d-ba39-2fe85c8c4cad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:47:02 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-b6b92616-6eef-4375-b4f6-299d7c2d40f6 tempest-VolumesActionsTest-1504098856 None] Created volume successfully. Sep 10 15:47:02 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-3ef914b1-ec23-441a-996c-7f501d1a79cb tempest-VolumesActionsTest-1504098856 None] Acquiring lock "cinder-3917ed27-e17b-4827-88d6-7c677f24359d" by "attach_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:02 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-3ef914b1-ec23-441a-996c-7f501d1a79cb tempest-VolumesActionsTest-1504098856 None] Lock "cinder-3917ed27-e17b-4827-88d6-7c677f24359d" acquired by "attach_volume" :: waited 0.086s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:03 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-3ef914b1-ec23-441a-996c-7f501d1a79cb tempest-VolumesActionsTest-1504098856 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:03 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-3ef914b1-ec23-441a-996c-7f501d1a79cb tempest-VolumesActionsTest-1504098856 None] Attaching volume 3917ed27-e17b-4827-88d6-7c677f24359d to instance c3e4be21-a542-4f99-825c-b8bf5956b84b at mountpoint /dev/vdb on host None. Sep 10 15:47:03 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-3ef914b1-ec23-441a-996c-7f501d1a79cb tempest-VolumesActionsTest-1504098856 None] Attach volume completed successfully. Sep 10 15:47:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-3ef914b1-ec23-441a-996c-7f501d1a79cb tempest-VolumesActionsTest-1504098856 None] Lock "cinder-3917ed27-e17b-4827-88d6-7c677f24359d" released by "attach_volume" :: held 1.034s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:47:05 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-51939752-8991-40bc-b882-040a8120a5b7 tempest-VolumesActionsTest-1241534000 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:05 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-51939752-8991-40bc-b882-040a8120a5b7 tempest-VolumesActionsTest-1241534000 None] Terminate volume connection completed successfully. Sep 10 15:47:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-1c933d6f-110a-441e-9fc1-47c9ef93c825 req-c24786ec-65c2-467c-ad1a-4910a35744ea tempest-TestServerVolumeAttachmentScenario-1935644716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-1c933d6f-110a-441e-9fc1-47c9ef93c825 req-c24786ec-65c2-467c-ad1a-4910a35744ea tempest-TestServerVolumeAttachmentScenario-1935644716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:05 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[c168ae62-fe2a-4520-b7a9-16ace75adeeb]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:47:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-1c933d6f-110a-441e-9fc1-47c9ef93c825 req-c24786ec-65c2-467c-ad1a-4910a35744ea tempest-TestServerVolumeAttachmentScenario-1935644716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-25a330be-3bf3-4879-a586-c268af018a59 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:06 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-51939752-8991-40bc-b882-040a8120a5b7 tempest-VolumesActionsTest-1241534000 None] Acquiring lock "cinder-3917ed27-e17b-4827-88d6-7c677f24359d-detach_volume" by "detach_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:06 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-51939752-8991-40bc-b882-040a8120a5b7 tempest-VolumesActionsTest-1241534000 None] Lock "cinder-3917ed27-e17b-4827-88d6-7c677f24359d-detach_volume" acquired by "detach_volume" :: waited 0.219s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:06 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-51939752-8991-40bc-b882-040a8120a5b7 tempest-VolumesActionsTest-1241534000 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:06 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-51939752-8991-40bc-b882-040a8120a5b7 tempest-VolumesActionsTest-1241534000 None] Detaching volume 3917ed27-e17b-4827-88d6-7c677f24359d from instance c3e4be21-a542-4f99-825c-b8bf5956b84b. Sep 10 15:47:06 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-51939752-8991-40bc-b882-040a8120a5b7 tempest-VolumesActionsTest-1241534000 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:06 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-51939752-8991-40bc-b882-040a8120a5b7 tempest-VolumesActionsTest-1241534000 None] Detach volume completed successfully. Sep 10 15:47:06 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-51939752-8991-40bc-b882-040a8120a5b7 tempest-VolumesActionsTest-1241534000 None] Lock "cinder-3917ed27-e17b-4827-88d6-7c677f24359d-detach_volume" released by "detach_volume" :: held 0.535s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:47:07 devstack quobyte-client[82814]: System call of process 96770 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:47:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-1c933d6f-110a-441e-9fc1-47c9ef93c825 req-c24786ec-65c2-467c-ad1a-4910a35744ea tempest-TestServerVolumeAttachmentScenario-1935644716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-25a330be-3bf3-4879-a586-c268af018a59" returned: 0 in 1.586s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-1c933d6f-110a-441e-9fc1-47c9ef93c825 req-c24786ec-65c2-467c-ad1a-4910a35744ea tempest-TestServerVolumeAttachmentScenario-1935644716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.627s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:07 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-1c933d6f-110a-441e-9fc1-47c9ef93c825 req-c24786ec-65c2-467c-ad1a-4910a35744ea tempest-TestServerVolumeAttachmentScenario-1935644716 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5', 'name': 'volume-25a330be-3bf3-4879-a586-c268af018a59', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a9fc460-3e11-4618-bc04-bbded41bea93', 'enforce_multipath': True} {{(pid=82800) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 15:47:07 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-1c933d6f-110a-441e-9fc1-47c9ef93c825 req-c24786ec-65c2-467c-ad1a-4910a35744ea tempest-TestServerVolumeAttachmentScenario-1935644716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:07 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-29ecf24f-3a78-4b1c-935f-03d5489018ad tempest-VolumesActionsTest-1504098856 None] Acquiring lock "cinder-3917ed27-e17b-4827-88d6-7c677f24359d-detach_volume" by "detach_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:07 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-29ecf24f-3a78-4b1c-935f-03d5489018ad tempest-VolumesActionsTest-1504098856 None] Lock "cinder-3917ed27-e17b-4827-88d6-7c677f24359d-detach_volume" acquired by "detach_volume" :: waited 0.082s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:07 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-29ecf24f-3a78-4b1c-935f-03d5489018ad tempest-VolumesActionsTest-1504098856 None] Volume detach called, but volume not attached. Sep 10 15:47:07 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-1c933d6f-110a-441e-9fc1-47c9ef93c825 req-c24786ec-65c2-467c-ad1a-4910a35744ea tempest-TestServerVolumeAttachmentScenario-1935644716 None] attachment_update completed successfully. Sep 10 15:47:07 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-29ecf24f-3a78-4b1c-935f-03d5489018ad tempest-VolumesActionsTest-1504098856 None] Lock "cinder-3917ed27-e17b-4827-88d6-7c677f24359d-detach_volume" released by "detach_volume" :: held 0.108s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:47:08 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-76965563-7669-40cd-8689-a42010827bef tempest-VolumesActionsTest-1504098856 None] Acquiring lock "cinder-3917ed27-e17b-4827-88d6-7c677f24359d-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:08 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-76965563-7669-40cd-8689-a42010827bef tempest-VolumesActionsTest-1504098856 None] Lock "cinder-3917ed27-e17b-4827-88d6-7c677f24359d-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:08 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-76965563-7669-40cd-8689-a42010827bef tempest-VolumesActionsTest-1504098856 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:08 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-76965563-7669-40cd-8689-a42010827bef tempest-VolumesActionsTest-1504098856 None] Acquiring lock "cinder-quobyte-3917ed27-e17b-4827-88d6-7c677f24359d" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:08 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-76965563-7669-40cd-8689-a42010827bef tempest-VolumesActionsTest-1504098856 None] Lock "cinder-quobyte-3917ed27-e17b-4827-88d6-7c677f24359d" acquired by "delete_volume" :: waited 0.068s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:09 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e467a78-ea48-4953-a82a-904c70f4d74d]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:47:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-76965563-7669-40cd-8689-a42010827bef tempest-VolumesActionsTest-1504098856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3917ed27-e17b-4827-88d6-7c677f24359d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:10 devstack quobyte-client[82814]: System call of process 96797 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:47:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-76965563-7669-40cd-8689-a42010827bef tempest-VolumesActionsTest-1504098856 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3917ed27-e17b-4827-88d6-7c677f24359d" returned: 0 in 1.398s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-76965563-7669-40cd-8689-a42010827bef tempest-VolumesActionsTest-1504098856 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3917ed27-e17b-4827-88d6-7c677f24359d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-76965563-7669-40cd-8689-a42010827bef tempest-VolumesActionsTest-1504098856 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3917ed27-e17b-4827-88d6-7c677f24359d" returned: 0 in 0.280s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:11 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-76965563-7669-40cd-8689-a42010827bef tempest-VolumesActionsTest-1504098856 None] Lock "cinder-quobyte-3917ed27-e17b-4827-88d6-7c677f24359d" released by "delete_volume" :: held 2.201s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:47:11 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-76965563-7669-40cd-8689-a42010827bef tempest-VolumesActionsTest-1504098856 None] Created reservations ['f0434b56-8f74-4281-9319-00b51648e2aa', '9d5ad946-287c-441f-96f1-2776d629c3c8', 'cfd37605-7558-400f-89a2-fcd3e68f5735', '0ea16da1-74fb-45e2-a451-e2f17eddd1a2'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:47:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-76965563-7669-40cd-8689-a42010827bef tempest-VolumesActionsTest-1504098856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-76965563-7669-40cd-8689-a42010827bef tempest-VolumesActionsTest-1504098856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:12 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-76965563-7669-40cd-8689-a42010827bef tempest-VolumesActionsTest-1504098856 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:47:12 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-76965563-7669-40cd-8689-a42010827bef tempest-VolumesActionsTest-1504098856 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:47:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-76965563-7669-40cd-8689-a42010827bef tempest-VolumesActionsTest-1504098856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.061s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-76965563-7669-40cd-8689-a42010827bef tempest-VolumesActionsTest-1504098856 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-76965563-7669-40cd-8689-a42010827bef tempest-VolumesActionsTest-1504098856 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.373s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:12 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-76965563-7669-40cd-8689-a42010827bef tempest-VolumesActionsTest-1504098856 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:47:13 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-76965563-7669-40cd-8689-a42010827bef tempest-VolumesActionsTest-1504098856 None] Deleted volume successfully. Sep 10 15:47:13 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-76965563-7669-40cd-8689-a42010827bef tempest-VolumesActionsTest-1504098856 None] Lock "cinder-3917ed27-e17b-4827-88d6-7c677f24359d-delete_volume" released by "delete_volume" :: held 4.981s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:47:22 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=24,cinder:UPDATE=16,cinder:INSERT=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:47:22 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:22 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:47:22 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Flow 'volume_create_manager' (c3c301b8-9f24-4f1b-8a6c-1eccfd7f5ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:47:22 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c1f4f1d-7390-4211-b6a1-525ea0cb779b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:22 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c1f4f1d-7390-4211-b6a1-525ea0cb779b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1395049603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d09d6c-b998-4c1f-9c59-29aae3c62a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b8d488e72442aebc0325d087242da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:47:22Z,use_quota=True,user_id='a22a1eb62a7849e4928da703ecde0b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:22 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c285f0-7eb9-4967-9384-93f2234ecfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:22 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c285f0-7eb9-4967-9384-93f2234ecfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:22 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6835208a-03ba-4448-a8ce-04c12260c4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:22 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6835208a-03ba-4448-a8ce-04c12260c4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9d09d6c-b998-4c1f-9c59-29aae3c62a30', 'volume_name': 'volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:22 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ee839f-ed4f-489b-9b3a-2cb9dcdb5d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:22 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ee839f-ed4f-489b-9b3a-2cb9dcdb5d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:22 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ddf5f0-6316-48e5-92d9-c2ba41cb91ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:22 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume b9d09d6c-b998-4c1f-9c59-29aae3c62a30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30', 'volume_size': 1} Sep 10 15:47:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:22 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1395049603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d09d6c-b998-4c1f-9c59-29aae3c62a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b8d488e72442aebc0325d087242da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:47:22Z,use_quota=True,user_id='a22a1eb62a7849e4928da703ecde0b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:47:22 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Creating volume b9d09d6c-b998-4c1f-9c59-29aae3c62a30 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:47:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:22 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:47:22 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:47:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:22 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:47:22 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:47:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:23 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=100, name=volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:47:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30 1073741824" returned: 0 in 0.486s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30" returned: 0 in 0.138s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:23 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] <== create_volume: return (708ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:47:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ddf5f0-6316-48e5-92d9-c2ba41cb91ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0471f386-3446-42a3-b426-1818417d72e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:23 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30 (b9d09d6c-b998-4c1f-9c59-29aae3c62a30): created successfully Sep 10 15:47:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0471f386-3446-42a3-b426-1818417d72e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Flow 'volume_create_manager' (c3c301b8-9f24-4f1b-8a6c-1eccfd7f5ed0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:47:23 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-357e18ec-aa9a-49b2-a28d-bb89524cb933 tempest-CreateVolumesFromSnapshotTest-786407751 None] Created volume successfully. Sep 10 15:47:25 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-ca0f7828-52b0-4ab4-ab9c-1930861c8bd3 tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ca0f7828-52b0-4ab4-ab9c-1930861c8bd3 tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ca0f7828-52b0-4ab4-ab9c-1930861c8bd3 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-ca0f7828-52b0-4ab4-ab9c-1930861c8bd3 tempest-CreateVolumesFromSnapshotTest-786407751 None] Creating offline snapshot f3dfcc32-5ba6-44f3-92d3-5355f1cc3f43 of volume b9d09d6c-b998-4c1f-9c59-29aae3c62a30 {{(pid=82800) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 15:47:25 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[91141624-786d-4913-b226-7ea3cfad012d]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:47:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ca0f7828-52b0-4ab4-ab9c-1930861c8bd3 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ca0f7828-52b0-4ab4-ab9c-1930861c8bd3 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30" returned: 0 in 0.530s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ca0f7828-52b0-4ab4-ab9c-1930861c8bd3 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30.f3dfcc32-5ba6-44f3-92d3-5355f1cc3f43 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:25 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=101, name=volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30.f3dfcc32-5ba6-44f3-92d3-5355f1cc3f43, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:47:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ca0f7828-52b0-4ab4-ab9c-1930861c8bd3 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30.f3dfcc32-5ba6-44f3-92d3-5355f1cc3f43 1G" returned: 0 in 0.293s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ca0f7828-52b0-4ab4-ab9c-1930861c8bd3 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30.f3dfcc32-5ba6-44f3-92d3-5355f1cc3f43 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ca0f7828-52b0-4ab4-ab9c-1930861c8bd3 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "qemu-img rebase -u -b volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30.f3dfcc32-5ba6-44f3-92d3-5355f1cc3f43" returned: 0 in 0.153s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-ca0f7828-52b0-4ab4-ab9c-1930861c8bd3 tempest-CreateVolumesFromSnapshotTest-786407751 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30.f3dfcc32-5ba6-44f3-92d3-5355f1cc3f43 is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:47:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ca0f7828-52b0-4ab4-ab9c-1930861c8bd3 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30.f3dfcc32-5ba6-44f3-92d3-5355f1cc3f43 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ca0f7828-52b0-4ab4-ab9c-1930861c8bd3 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30.f3dfcc32-5ba6-44f3-92d3-5355f1cc3f43" returned: 0 in 0.133s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-ca0f7828-52b0-4ab4-ab9c-1930861c8bd3 tempest-CreateVolumesFromSnapshotTest-786407751 None] Setting permissions: /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30 -> 1000:1000 {{(pid=82800) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 15:47:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ca0f7828-52b0-4ab4-ab9c-1930861c8bd3 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30.f3dfcc32-5ba6-44f3-92d3-5355f1cc3f43 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ca0f7828-52b0-4ab4-ab9c-1930861c8bd3 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30.f3dfcc32-5ba6-44f3-92d3-5355f1cc3f43" returned: 0 in 0.113s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ca0f7828-52b0-4ab4-ab9c-1930861c8bd3 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ca0f7828-52b0-4ab4-ab9c-1930861c8bd3 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30.info" returned: 0 in 0.092s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-ca0f7828-52b0-4ab4-ab9c-1930861c8bd3 tempest-CreateVolumesFromSnapshotTest-786407751 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30.info is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:47:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ca0f7828-52b0-4ab4-ab9c-1930861c8bd3 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ca0f7828-52b0-4ab4-ab9c-1930861c8bd3 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30.info" returned: 0 in 0.092s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ca0f7828-52b0-4ab4-ab9c-1930861c8bd3 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.773s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:27 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-ca0f7828-52b0-4ab4-ab9c-1930861c8bd3 tempest-CreateVolumesFromSnapshotTest-786407751 None] Create snapshot completed successfully Sep 10 15:47:28 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:28 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:47:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Flow 'volume_create_manager' (b5cea66a-733c-43d2-96fd-824c7c994d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:47:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85d94d46-61bc-42a1-87ed-a273807de4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85d94d46-61bc-42a1-87ed-a273807de4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1257697276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9add27f3-1d10-4b68-a8b4-6e6f5045fd9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1f49282afc4150b10dceffb5d7f6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:47:28Z,use_quota=True,user_id='d677841be9b04ed081fb21d3fa8cf52e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d1161dd-faba-4625-bc17-6a1ad5787d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d1161dd-faba-4625-bc17-6a1ad5787d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970a6704-512a-4c59-a9e1-fcee8491b16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (970a6704-512a-4c59-a9e1-fcee8491b16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9add27f3-1d10-4b68-a8b4-6e6f5045fd9c', 'volume_name': 'volume-9add27f3-1d10-4b68-a8b4-6e6f5045fd9c', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc419601-4d87-4f29-b9b0-214135b061b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc419601-4d87-4f29-b9b0-214135b061b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dffd95e0-b836-45a2-918e-4586c01afbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:28 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Volume 9add27f3-1d10-4b68-a8b4-6e6f5045fd9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9add27f3-1d10-4b68-a8b4-6e6f5045fd9c', 'volume_size': 1} Sep 10 15:47:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1257697276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9add27f3-1d10-4b68-a8b4-6e6f5045fd9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1f49282afc4150b10dceffb5d7f6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:47:28Z,use_quota=True,user_id='d677841be9b04ed081fb21d3fa8cf52e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:47:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Creating volume 9add27f3-1d10-4b68-a8b4-6e6f5045fd9c {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:47:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:47:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:47:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:47:28 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:47:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9add27f3-1d10-4b68-a8b4-6e6f5045fd9c 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:28 devstack quobyte-client[82814]: System call of process 96892 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:47:28 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=103, name=volume-9add27f3-1d10-4b68-a8b4-6e6f5045fd9c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:47:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9add27f3-1d10-4b68-a8b4-6e6f5045fd9c 1073741824" returned: 0 in 0.686s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9add27f3-1d10-4b68-a8b4-6e6f5045fd9c {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:29 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:29 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:47:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Flow 'volume_create_manager' (961e4037-b93f-460b-b9b7-65bd5eeb8734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:47:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ffd601a-b597-4832-b75d-134f603ab76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:47:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:47:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:47:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:30 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ffd601a-b597-4832-b75d-134f603ab76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2098445774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b3f1b17-a847-404e-887b-a63fbafd3e3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b8d488e72442aebc0325d087242da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:47:29Z,use_quota=True,user_id='a22a1eb62a7849e4928da703ecde0b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:30 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7aa5b8-4c38-40e6-83bc-e130f76d567c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:30 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f7aa5b8-4c38-40e6-83bc-e130f76d567c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:30 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc60eeb6-b022-49f8-9ac1-3bf540242668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:30 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc60eeb6-b022-49f8-9ac1-3bf540242668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b3f1b17-a847-404e-887b-a63fbafd3e3b', 'volume_name': 'volume-0b3f1b17-a847-404e-887b-a63fbafd3e3b', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:30 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6937b6d-12ee-48a9-9b64-7bf17d8c66ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:30 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6937b6d-12ee-48a9-9b64-7bf17d8c66ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:30 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643e3af7-1c70-492a-a1ef-57f6f7fea2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:30 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume 0b3f1b17-a847-404e-887b-a63fbafd3e3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b3f1b17-a847-404e-887b-a63fbafd3e3b', 'volume_size': 1} Sep 10 15:47:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9add27f3-1d10-4b68-a8b4-6e6f5045fd9c" returned: 0 in 1.264s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] <== create_volume: return (1993ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:47:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.075s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2098445774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b3f1b17-a847-404e-887b-a63fbafd3e3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b8d488e72442aebc0325d087242da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:47:29Z,use_quota=True,user_id='a22a1eb62a7849e4928da703ecde0b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:47:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Creating volume 0b3f1b17-a847-404e-887b-a63fbafd3e3b {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:47:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:47:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:47:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:47:30 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:47:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-0b3f1b17-a847-404e-887b-a63fbafd3e3b 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:30 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:30 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:47:30 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=104, name=volume-0b3f1b17-a847-404e-887b-a63fbafd3e3b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:47:30 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Flow 'volume_create_manager' (524be49d-fe2c-4038-9a64-6aed70da1628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:47:30 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c622c1-03fb-4d9a-93fa-d405dda3ab31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:30 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:30 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Flow 'volume_create_manager' (a6996333-a3a8-463a-8768-a88f640d74f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (955ddd51-f97e-4db4-825c-6ff3fac49fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:31 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Flow 'volume_create_manager' (0fd0b6bd-1e42-4ea3-ba82-bb7788cb8238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b0d8a86-60da-47bd-9bc6-478ed321969f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 1.411s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c622c1-03fb-4d9a-93fa-d405dda3ab31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-661040168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b4bd81-ae39-4f44-80b7-f6faea1ea8ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b8d488e72442aebc0325d087242da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:47:30Z,use_quota=True,user_id='a22a1eb62a7849e4928da703ecde0b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d6c05b-2b42-42ac-910b-eb973e580e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d6c05b-2b42-42ac-910b-eb973e580e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b470062-dbb8-4b6e-9d20-267cc93b9eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b470062-dbb8-4b6e-9d20-267cc93b9eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9b4bd81-ae39-4f44-80b7-f6faea1ea8ac', 'volume_name': 'volume-c9b4bd81-ae39-4f44-80b7-f6faea1ea8ac', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c204ff-b1af-42f6-b264-268f542839ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c204ff-b1af-42f6-b264-268f542839ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64850a52-5a47-46f8-a47c-1c23fa960edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:31 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume c9b4bd81-ae39-4f44-80b7-f6faea1ea8ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9b4bd81-ae39-4f44-80b7-f6faea1ea8ac', 'volume_size': 1} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b0d8a86-60da-47bd-9bc6-478ed321969f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-147170229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70787733-0403-4b20-93b3-8693466a7ed6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b8d488e72442aebc0325d087242da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:47:30Z,use_quota=True,user_id='a22a1eb62a7849e4928da703ecde0b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (734c3628-d3f7-4a04-a377-2ad22482a5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (734c3628-d3f7-4a04-a377-2ad22482a5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0258213-72bc-485a-a9c1-ce833a800384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0258213-72bc-485a-a9c1-ce833a800384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70787733-0403-4b20-93b3-8693466a7ed6', 'volume_name': 'volume-70787733-0403-4b20-93b3-8693466a7ed6', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c85e2880-6d9f-4997-aecc-bf2569d5451d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c85e2880-6d9f-4997-aecc-bf2569d5451d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d13d15f5-69a9-463a-a415-ffa38607ce8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:31 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume 70787733-0403-4b20-93b3-8693466a7ed6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70787733-0403-4b20-93b3-8693466a7ed6', 'volume_size': 1} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-0b3f1b17-a847-404e-887b-a63fbafd3e3b 1073741824" returned: 0 in 0.854s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-0b3f1b17-a847-404e-887b-a63fbafd3e3b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (955ddd51-f97e-4db4-825c-6ff3fac49fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2144602245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71787e71-13d9-48cf-9554-77754344fe1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b8d488e72442aebc0325d087242da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:47:29Z,use_quota=True,user_id='a22a1eb62a7849e4928da703ecde0b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bef0ddb-48a7-40ec-8dc8-6d4eddb063f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bef0ddb-48a7-40ec-8dc8-6d4eddb063f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec736f9-a525-46ca-ac89-ed90cdcd9c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec736f9-a525-46ca-ac89-ed90cdcd9c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71787e71-13d9-48cf-9554-77754344fe1a', 'volume_name': 'volume-71787e71-13d9-48cf-9554-77754344fe1a', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a7f7d5f-df71-4a50-a303-85b66fe7d7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a7f7d5f-df71-4a50-a303-85b66fe7d7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c480fe7c-b641-484f-bc73-ec3975b32ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:31 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume 71787e71-13d9-48cf-9554-77754344fe1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71787e71-13d9-48cf-9554-77754344fe1a', 'volume_size': 1} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:31 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Flow 'volume_create_manager' (4fb68cbd-1615-4fe2-a9d8-9ff8ca618e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556ae4a9-1507-4160-b844-a1649c675380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-0b3f1b17-a847-404e-887b-a63fbafd3e3b" returned: 0 in 0.516s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] <== create_volume: return (1389ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dffd95e0-b836-45a2-918e-4586c01afbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9add27f3-1d10-4b68-a8b4-6e6f5045fd9c', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd61156e-ec90-4d66-9be1-06a15d4b5de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.632s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-661040168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b4bd81-ae39-4f44-80b7-f6faea1ea8ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b8d488e72442aebc0325d087242da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:47:30Z,use_quota=True,user_id='a22a1eb62a7849e4928da703ecde0b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Creating volume c9b4bd81-ae39-4f44-80b7-f6faea1ea8ac {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:47:31 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:47:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c9b4bd81-ae39-4f44-80b7-f6faea1ea8ac 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:32 devstack quobyte-client[82814]: System call of process 96903 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:47:32 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=105, name=volume-c9b4bd81-ae39-4f44-80b7-f6faea1ea8ac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556ae4a9-1507-4160-b844-a1649c675380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-564432646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9040bde6-987a-4808-80d6-7398499468c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b8d488e72442aebc0325d087242da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:47:31Z,use_quota=True,user_id='a22a1eb62a7849e4928da703ecde0b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5be3415-4e31-4919-9fde-77eac2b827bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5be3415-4e31-4919-9fde-77eac2b827bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89430365-38d4-4d76-99d3-01c47c2f74b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89430365-38d4-4d76-99d3-01c47c2f74b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9040bde6-987a-4808-80d6-7398499468c8', 'volume_name': 'volume-9040bde6-987a-4808-80d6-7398499468c8', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5f36d3-f0c4-4d31-ac96-aefda665902a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5f36d3-f0c4-4d31-ac96-aefda665902a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9786d117-8748-47ab-8a6c-2652d3a547b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:32 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume 9040bde6-987a-4808-80d6-7398499468c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9040bde6-987a-4808-80d6-7398499468c8', 'volume_size': 1} Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:32 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Volume volume-9add27f3-1d10-4b68-a8b4-6e6f5045fd9c (9add27f3-1d10-4b68-a8b4-6e6f5045fd9c): created successfully Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd61156e-ec90-4d66-9be1-06a15d4b5de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Flow 'volume_create_manager' (b5cea66a-733c-43d2-96fd-824c7c994d25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643e3af7-1c70-492a-a1ef-57f6f7fea2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b3f1b17-a847-404e-887b-a63fbafd3e3b', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea14f68c-88f1-4715-90bf-864e2717cf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c9b4bd81-ae39-4f44-80b7-f6faea1ea8ac 1073741824" returned: 0 in 0.526s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c9b4bd81-ae39-4f44-80b7-f6faea1ea8ac {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:32 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-6953aa2b-b015-4e55-b699-7f28f4b0c908 tempest-VolumesActionsTest-1504098856 None] Created volume successfully. Sep 10 15:47:32 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume volume-0b3f1b17-a847-404e-887b-a63fbafd3e3b (0b3f1b17-a847-404e-887b-a63fbafd3e3b): created successfully Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea14f68c-88f1-4715-90bf-864e2717cf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Flow 'volume_create_manager' (961e4037-b93f-460b-b9b7-65bd5eeb8734) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c9b4bd81-ae39-4f44-80b7-f6faea1ea8ac" returned: 0 in 0.481s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] <== create_volume: return (1029ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.679s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-147170229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70787733-0403-4b20-93b3-8693466a7ed6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b8d488e72442aebc0325d087242da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:47:30Z,use_quota=True,user_id='a22a1eb62a7849e4928da703ecde0b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Creating volume 70787733-0403-4b20-93b3-8693466a7ed6 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:47:32 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:47:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-70787733-0403-4b20-93b3-8693466a7ed6 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:33 devstack quobyte-client[82814]: System call of process 96908 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:47:33 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=106, name=volume-70787733-0403-4b20-93b3-8693466a7ed6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:47:33 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0e09e138-43f4-4a54-b463-75c5e14649dd tempest-VolumesActionsTest-1241534000 None] Acquiring lock "cinder-9add27f3-1d10-4b68-a8b4-6e6f5045fd9c-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:33 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-64dfc8dc-f1d0-4718-9d35-62f5a6bc1c84 tempest-CreateVolumesFromSnapshotTest-786407751 None] Created volume successfully. Sep 10 15:47:33 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64850a52-5a47-46f8-a47c-1c23fa960edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9b4bd81-ae39-4f44-80b7-f6faea1ea8ac', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:33 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50230e74-6847-4115-a0f1-65bfb84f448b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:33 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0e09e138-43f4-4a54-b463-75c5e14649dd tempest-VolumesActionsTest-1241534000 None] Lock "cinder-9add27f3-1d10-4b68-a8b4-6e6f5045fd9c-delete_volume" acquired by "delete_volume" :: waited 0.362s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-70787733-0403-4b20-93b3-8693466a7ed6 1073741824" returned: 0 in 0.610s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-70787733-0403-4b20-93b3-8693466a7ed6 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:33 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume volume-c9b4bd81-ae39-4f44-80b7-f6faea1ea8ac (c9b4bd81-ae39-4f44-80b7-f6faea1ea8ac): created successfully Sep 10 15:47:33 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50230e74-6847-4115-a0f1-65bfb84f448b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:33 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Flow 'volume_create_manager' (524be49d-fe2c-4038-9a64-6aed70da1628) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:47:33 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-d5ff13af-0e24-4b78-9766-205228e450a5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Created volume successfully. Sep 10 15:47:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-70787733-0403-4b20-93b3-8693466a7ed6" returned: 0 in 0.343s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:33 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] <== create_volume: return (979ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:47:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.420s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:33 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2144602245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71787e71-13d9-48cf-9554-77754344fe1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b8d488e72442aebc0325d087242da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:47:29Z,use_quota=True,user_id='a22a1eb62a7849e4928da703ecde0b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:47:33 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Creating volume 71787e71-13d9-48cf-9554-77754344fe1a {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:47:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:33 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:47:33 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:47:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:33 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:47:33 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:47:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-71787e71-13d9-48cf-9554-77754344fe1a 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:34 devstack quobyte-client[82814]: System call of process 96912 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:47:34 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=107, name=volume-71787e71-13d9-48cf-9554-77754344fe1a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:47:34 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-0e09e138-43f4-4a54-b463-75c5e14649dd tempest-VolumesActionsTest-1241534000 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:34 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0e09e138-43f4-4a54-b463-75c5e14649dd tempest-VolumesActionsTest-1241534000 None] Acquiring lock "cinder-quobyte-9add27f3-1d10-4b68-a8b4-6e6f5045fd9c" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d13d15f5-69a9-463a-a415-ffa38607ce8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70787733-0403-4b20-93b3-8693466a7ed6', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6859aa-ee17-4e20-9a10-134f5c87c8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-71787e71-13d9-48cf-9554-77754344fe1a 1073741824" returned: 0 in 0.577s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-71787e71-13d9-48cf-9554-77754344fe1a {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:34 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0e09e138-43f4-4a54-b463-75c5e14649dd tempest-VolumesActionsTest-1241534000 None] Lock "cinder-quobyte-9add27f3-1d10-4b68-a8b4-6e6f5045fd9c" acquired by "delete_volume" :: waited 0.261s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:34 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume volume-70787733-0403-4b20-93b3-8693466a7ed6 (70787733-0403-4b20-93b3-8693466a7ed6): created successfully Sep 10 15:47:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6859aa-ee17-4e20-9a10-134f5c87c8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Flow 'volume_create_manager' (0fd0b6bd-1e42-4ea3-ba82-bb7788cb8238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:47:34 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[39db9de3-982a-416f-8ecf-3674913b0e96]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:47:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0e09e138-43f4-4a54-b463-75c5e14649dd tempest-VolumesActionsTest-1241534000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9add27f3-1d10-4b68-a8b4-6e6f5045fd9c {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:35 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-d63f249c-34bd-492b-92cf-5ea27f6af2b8 tempest-CreateVolumesFromSnapshotTest-786407751 None] Created volume successfully. Sep 10 15:47:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-71787e71-13d9-48cf-9554-77754344fe1a" returned: 0 in 0.685s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:35 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] <== create_volume: return (1286ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:47:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.019s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:35 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-564432646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9040bde6-987a-4808-80d6-7398499468c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b8d488e72442aebc0325d087242da8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:47:31Z,use_quota=True,user_id='a22a1eb62a7849e4928da703ecde0b60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:47:35 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Creating volume 9040bde6-987a-4808-80d6-7398499468c8 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:47:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:35 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:47:35 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:47:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:35 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:47:35 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:47:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9040bde6-987a-4808-80d6-7398499468c8 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:35 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=108, name=volume-9040bde6-987a-4808-80d6-7398499468c8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:47:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c480fe7c-b641-484f-bc73-ec3975b32ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71787e71-13d9-48cf-9554-77754344fe1a', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e34723e-d8d8-41d1-b680-1be1865f09c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0e09e138-43f4-4a54-b463-75c5e14649dd tempest-VolumesActionsTest-1241534000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9add27f3-1d10-4b68-a8b4-6e6f5045fd9c" returned: 0 in 0.860s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0e09e138-43f4-4a54-b463-75c5e14649dd tempest-VolumesActionsTest-1241534000 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9add27f3-1d10-4b68-a8b4-6e6f5045fd9c {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:35 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume volume-71787e71-13d9-48cf-9554-77754344fe1a (71787e71-13d9-48cf-9554-77754344fe1a): created successfully Sep 10 15:47:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e34723e-d8d8-41d1-b680-1be1865f09c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Flow 'volume_create_manager' (a6996333-a3a8-463a-8768-a88f640d74f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:47:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9040bde6-987a-4808-80d6-7398499468c8 1073741824" returned: 0 in 0.795s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9040bde6-987a-4808-80d6-7398499468c8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0e09e138-43f4-4a54-b463-75c5e14649dd tempest-VolumesActionsTest-1241534000 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9add27f3-1d10-4b68-a8b4-6e6f5045fd9c" returned: 0 in 0.373s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9040bde6-987a-4808-80d6-7398499468c8" returned: 0 in 0.155s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:36 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] <== create_volume: return (983ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:47:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:36 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0e09e138-43f4-4a54-b463-75c5e14649dd tempest-VolumesActionsTest-1241534000 None] Lock "cinder-quobyte-9add27f3-1d10-4b68-a8b4-6e6f5045fd9c" released by "delete_volume" :: held 1.750s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:47:36 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-03b5f1e6-c9ba-4fa5-bc96-9003326bb487 tempest-CreateVolumesFromSnapshotTest-786407751 None] Created volume successfully. Sep 10 15:47:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9786d117-8748-47ab-8a6c-2652d3a547b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9040bde6-987a-4808-80d6-7398499468c8', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c788338c-26f5-42bc-bf36-858db61b7b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:37 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-0e09e138-43f4-4a54-b463-75c5e14649dd tempest-VolumesActionsTest-1241534000 None] Created reservations ['0a0f8278-7b62-46a4-be72-87cb33d4e26b', 'e8f22761-0c34-4dd2-8778-427c383df4e5', 'b73d3dcb-c954-46d3-9b6a-0d4ea520599b', '28777cd0-0353-456f-9296-ca8a4db01c09'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:47:37 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume volume-9040bde6-987a-4808-80d6-7398499468c8 (9040bde6-987a-4808-80d6-7398499468c8): created successfully Sep 10 15:47:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c788338c-26f5-42bc-bf36-858db61b7b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Flow 'volume_create_manager' (4fb68cbd-1615-4fe2-a9d8-9ff8ca618e6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:47:37 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-1316f8a3-1181-4b6f-ab38-f2e8f1c7784a tempest-CreateVolumesFromSnapshotTest-786407751 None] Created volume successfully. Sep 10 15:47:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0e09e138-43f4-4a54-b463-75c5e14649dd tempest-VolumesActionsTest-1241534000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0e09e138-43f4-4a54-b463-75c5e14649dd tempest-VolumesActionsTest-1241534000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:37 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0e09e138-43f4-4a54-b463-75c5e14649dd tempest-VolumesActionsTest-1241534000 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:47:37 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0e09e138-43f4-4a54-b463-75c5e14649dd tempest-VolumesActionsTest-1241534000 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:47:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0e09e138-43f4-4a54-b463-75c5e14649dd tempest-VolumesActionsTest-1241534000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0e09e138-43f4-4a54-b463-75c5e14649dd tempest-VolumesActionsTest-1241534000 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0e09e138-43f4-4a54-b463-75c5e14649dd tempest-VolumesActionsTest-1241534000 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.092s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:37 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-0e09e138-43f4-4a54-b463-75c5e14649dd tempest-VolumesActionsTest-1241534000 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:47:37 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-0e09e138-43f4-4a54-b463-75c5e14649dd tempest-VolumesActionsTest-1241534000 None] Deleted volume successfully. Sep 10 15:47:38 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-73df0114-44ac-4166-8773-8c9c9da56739 tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "cinder-9040bde6-987a-4808-80d6-7398499468c8-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:38 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0e09e138-43f4-4a54-b463-75c5e14649dd tempest-VolumesActionsTest-1241534000 None] Lock "cinder-9add27f3-1d10-4b68-a8b4-6e6f5045fd9c-delete_volume" released by "delete_volume" :: held 4.686s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:47:38 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-73df0114-44ac-4166-8773-8c9c9da56739 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-9040bde6-987a-4808-80d6-7398499468c8-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:38 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-73df0114-44ac-4166-8773-8c9c9da56739 tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:38 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-73df0114-44ac-4166-8773-8c9c9da56739 tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "cinder-quobyte-9040bde6-987a-4808-80d6-7398499468c8" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:38 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-73df0114-44ac-4166-8773-8c9c9da56739 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-quobyte-9040bde6-987a-4808-80d6-7398499468c8" acquired by "delete_volume" :: waited 0.010s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:38 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec918a4-3b85-4800-b272-554e40ddb718]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:47:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-73df0114-44ac-4166-8773-8c9c9da56739 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9040bde6-987a-4808-80d6-7398499468c8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-73df0114-44ac-4166-8773-8c9c9da56739 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9040bde6-987a-4808-80d6-7398499468c8" returned: 0 in 0.608s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-73df0114-44ac-4166-8773-8c9c9da56739 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9040bde6-987a-4808-80d6-7398499468c8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-73df0114-44ac-4166-8773-8c9c9da56739 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9040bde6-987a-4808-80d6-7398499468c8" returned: 0 in 0.115s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:39 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-73df0114-44ac-4166-8773-8c9c9da56739 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-quobyte-9040bde6-987a-4808-80d6-7398499468c8" released by "delete_volume" :: held 0.907s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:47:39 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:39 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:47:39 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Flow 'volume_create_manager' (24892a48-e47a-4201-b0d7-642913bffbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:47:39 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d08a205-71f1-4767-aeba-a46124b51754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:39 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d08a205-71f1-4767-aeba-a46124b51754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-479571724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12855a84-a4ae-4e8a-9339-6cac8155c1b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1f49282afc4150b10dceffb5d7f6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:47:39Z,use_quota=True,user_id='d677841be9b04ed081fb21d3fa8cf52e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:39 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7566aa0-5caa-481f-949a-feea5f2370b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:39 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7566aa0-5caa-481f-949a-feea5f2370b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:39 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d5f123-1eca-4127-a1d8-0ed3c89509ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:39 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d5f123-1eca-4127-a1d8-0ed3c89509ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12855a84-a4ae-4e8a-9339-6cac8155c1b5', 'volume_name': 'volume-12855a84-a4ae-4e8a-9339-6cac8155c1b5', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:39 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0d8345-8568-4cea-b3f8-5a2409e0bb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:39 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0d8345-8568-4cea-b3f8-5a2409e0bb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:39 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d290dd7-914e-472d-a04a-9a39db9fbae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:39 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Volume 12855a84-a4ae-4e8a-9339-6cac8155c1b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12855a84-a4ae-4e8a-9339-6cac8155c1b5', 'volume_size': 1} Sep 10 15:47:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:39 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-479571724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12855a84-a4ae-4e8a-9339-6cac8155c1b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1f49282afc4150b10dceffb5d7f6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:47:39Z,use_quota=True,user_id='d677841be9b04ed081fb21d3fa8cf52e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:47:39 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Creating volume 12855a84-a4ae-4e8a-9339-6cac8155c1b5 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:47:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:39 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:47:39 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:47:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:39 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:47:39 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:47:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-12855a84-a4ae-4e8a-9339-6cac8155c1b5 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:40 devstack quobyte-client[82814]: System call of process 96930 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:47:40 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=109, name=volume-12855a84-a4ae-4e8a-9339-6cac8155c1b5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:47:40 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-b6899b36-cde4-467a-9838-f29178f1667c req-6f7893e9-41dd-4cf8-b35c-3469614d8fe9 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-12855a84-a4ae-4e8a-9339-6cac8155c1b5 1073741824" returned: 0 in 0.536s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-12855a84-a4ae-4e8a-9339-6cac8155c1b5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:40 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-b6899b36-cde4-467a-9838-f29178f1667c req-6f7893e9-41dd-4cf8-b35c-3469614d8fe9 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:40 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-b6899b36-cde4-467a-9838-f29178f1667c req-6f7893e9-41dd-4cf8-b35c-3469614d8fe9 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Terminate volume connection completed successfully. Sep 10 15:47:40 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-b6899b36-cde4-467a-9838-f29178f1667c req-6f7893e9-41dd-4cf8-b35c-3469614d8fe9 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Deleting attachment 9a9fc460-3e11-4618-bc04-bbded41bea93. {{(pid=82800) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 15:47:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-12855a84-a4ae-4e8a-9339-6cac8155c1b5" returned: 0 in 0.408s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:40 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] <== create_volume: return (969ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:47:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:40 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d290dd7-914e-472d-a04a-9a39db9fbae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12855a84-a4ae-4e8a-9339-6cac8155c1b5', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:40 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d870455-eee7-451d-99ae-019ffb8f36ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:40 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-73df0114-44ac-4166-8773-8c9c9da56739 tempest-CreateVolumesFromSnapshotTest-786407751 None] Created reservations ['c41126ee-6e4e-497f-8517-604968e5b838', 'd8123104-213f-49b8-8590-adbf159d35a7', 'f9910105-0d55-4f54-8018-e22f214acfbe', '0f7eb159-3147-418a-8bb9-9a91c88b30bc'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:47:41 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Volume volume-12855a84-a4ae-4e8a-9339-6cac8155c1b5 (12855a84-a4ae-4e8a-9339-6cac8155c1b5): created successfully Sep 10 15:47:41 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d870455-eee7-451d-99ae-019ffb8f36ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:41 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Flow 'volume_create_manager' (24892a48-e47a-4201-b0d7-642913bffbdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:47:41 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-c8ec7f9c-3c4c-4a44-9b10-76f2951b217c tempest-VolumesActionsTest-1504098856 None] Created volume successfully. Sep 10 15:47:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-73df0114-44ac-4166-8773-8c9c9da56739 tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-73df0114-44ac-4166-8773-8c9c9da56739 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:41 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-73df0114-44ac-4166-8773-8c9c9da56739 tempest-CreateVolumesFromSnapshotTest-786407751 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:47:41 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-73df0114-44ac-4166-8773-8c9c9da56739 tempest-CreateVolumesFromSnapshotTest-786407751 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:47:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-73df0114-44ac-4166-8773-8c9c9da56739 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-73df0114-44ac-4166-8773-8c9c9da56739 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-73df0114-44ac-4166-8773-8c9c9da56739 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.169s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:41 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-73df0114-44ac-4166-8773-8c9c9da56739 tempest-CreateVolumesFromSnapshotTest-786407751 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:47:41 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-73df0114-44ac-4166-8773-8c9c9da56739 tempest-CreateVolumesFromSnapshotTest-786407751 None] Deleted volume successfully. Sep 10 15:47:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-73df0114-44ac-4166-8773-8c9c9da56739 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-9040bde6-987a-4808-80d6-7398499468c8-delete_volume" released by "delete_volume" :: held 3.356s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:47:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-28679a9a-6983-4ad7-9298-363fa4a507db tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "cinder-c9b4bd81-ae39-4f44-80b7-f6faea1ea8ac-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-28679a9a-6983-4ad7-9298-363fa4a507db tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-c9b4bd81-ae39-4f44-80b7-f6faea1ea8ac-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:41 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-28679a9a-6983-4ad7-9298-363fa4a507db tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-28679a9a-6983-4ad7-9298-363fa4a507db tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "cinder-quobyte-c9b4bd81-ae39-4f44-80b7-f6faea1ea8ac" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-28679a9a-6983-4ad7-9298-363fa4a507db tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-quobyte-c9b4bd81-ae39-4f44-80b7-f6faea1ea8ac" acquired by "delete_volume" :: waited 0.011s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:41 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc0a46c-4a31-48a2-842f-f24267f95fc1]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:47:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-28679a9a-6983-4ad7-9298-363fa4a507db tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c9b4bd81-ae39-4f44-80b7-f6faea1ea8ac {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:42 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-21688a7c-08f9-4e7b-94e7-0c6a89342011 tempest-VolumesActionsTest-1241534000 None] Acquiring lock "cinder-12855a84-a4ae-4e8a-9339-6cac8155c1b5-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:42 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-21688a7c-08f9-4e7b-94e7-0c6a89342011 tempest-VolumesActionsTest-1241534000 None] Lock "cinder-12855a84-a4ae-4e8a-9339-6cac8155c1b5-delete_volume" acquired by "delete_volume" :: waited 0.133s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:42 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-21688a7c-08f9-4e7b-94e7-0c6a89342011 tempest-VolumesActionsTest-1241534000 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:42 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-21688a7c-08f9-4e7b-94e7-0c6a89342011 tempest-VolumesActionsTest-1241534000 None] Acquiring lock "cinder-quobyte-12855a84-a4ae-4e8a-9339-6cac8155c1b5" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-28679a9a-6983-4ad7-9298-363fa4a507db tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c9b4bd81-ae39-4f44-80b7-f6faea1ea8ac" returned: 0 in 0.745s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-28679a9a-6983-4ad7-9298-363fa4a507db tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c9b4bd81-ae39-4f44-80b7-f6faea1ea8ac {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:42 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-21688a7c-08f9-4e7b-94e7-0c6a89342011 tempest-VolumesActionsTest-1241534000 None] Lock "cinder-quobyte-12855a84-a4ae-4e8a-9339-6cac8155c1b5" acquired by "delete_volume" :: waited 0.168s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:42 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[152da0ed-4502-495a-bf4a-5572d879f8db]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:47:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-21688a7c-08f9-4e7b-94e7-0c6a89342011 tempest-VolumesActionsTest-1241534000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-12855a84-a4ae-4e8a-9339-6cac8155c1b5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-28679a9a-6983-4ad7-9298-363fa4a507db tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c9b4bd81-ae39-4f44-80b7-f6faea1ea8ac" returned: 0 in 0.316s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:43 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-28679a9a-6983-4ad7-9298-363fa4a507db tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-quobyte-c9b4bd81-ae39-4f44-80b7-f6faea1ea8ac" released by "delete_volume" :: held 1.269s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:47:43 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-28679a9a-6983-4ad7-9298-363fa4a507db tempest-CreateVolumesFromSnapshotTest-786407751 None] Created reservations ['98e06b7b-8876-4d75-b67b-bf3eee2f261b', '5ffd9992-66dc-4504-8364-a8c5fcad7283', '3e558824-4170-432a-aca6-dcdc0bc9ac87', '432dbad1-58de-44ce-8d1b-6cc1309ddd95'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:47:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-21688a7c-08f9-4e7b-94e7-0c6a89342011 tempest-VolumesActionsTest-1241534000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-12855a84-a4ae-4e8a-9339-6cac8155c1b5" returned: 0 in 0.606s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-21688a7c-08f9-4e7b-94e7-0c6a89342011 tempest-VolumesActionsTest-1241534000 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-12855a84-a4ae-4e8a-9339-6cac8155c1b5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-21688a7c-08f9-4e7b-94e7-0c6a89342011 tempest-VolumesActionsTest-1241534000 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-12855a84-a4ae-4e8a-9339-6cac8155c1b5" returned: 0 in 0.240s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:43 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-21688a7c-08f9-4e7b-94e7-0c6a89342011 tempest-VolumesActionsTest-1241534000 None] Lock "cinder-quobyte-12855a84-a4ae-4e8a-9339-6cac8155c1b5" released by "delete_volume" :: held 1.136s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:47:44 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-337589fe-39fe-4664-ad6a-a451ac339a71 tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "cinder-70787733-0403-4b20-93b3-8693466a7ed6-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-28679a9a-6983-4ad7-9298-363fa4a507db tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-28679a9a-6983-4ad7-9298-363fa4a507db tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-28679a9a-6983-4ad7-9298-363fa4a507db tempest-CreateVolumesFromSnapshotTest-786407751 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:47:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-28679a9a-6983-4ad7-9298-363fa4a507db tempest-CreateVolumesFromSnapshotTest-786407751 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:47:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-28679a9a-6983-4ad7-9298-363fa4a507db tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-28679a9a-6983-4ad7-9298-363fa4a507db tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:44 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-337589fe-39fe-4664-ad6a-a451ac339a71 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-70787733-0403-4b20-93b3-8693466a7ed6-delete_volume" acquired by "delete_volume" :: waited 0.404s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-28679a9a-6983-4ad7-9298-363fa4a507db tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.484s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:44 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-21688a7c-08f9-4e7b-94e7-0c6a89342011 tempest-VolumesActionsTest-1241534000 None] Created reservations ['c5796bf6-947b-44ab-bfc5-e794129828b2', '0360a56e-0352-4c7d-ae7d-5673f3d9138b', 'af0ce1ca-4d35-4912-b563-abdde3e19226', '65251ff3-3037-4231-bc64-c527f54e38e6'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:47:44 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-28679a9a-6983-4ad7-9298-363fa4a507db tempest-CreateVolumesFromSnapshotTest-786407751 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:47:44 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-28679a9a-6983-4ad7-9298-363fa4a507db tempest-CreateVolumesFromSnapshotTest-786407751 None] Deleted volume successfully. Sep 10 15:47:44 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-28679a9a-6983-4ad7-9298-363fa4a507db tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-c9b4bd81-ae39-4f44-80b7-f6faea1ea8ac-delete_volume" released by "delete_volume" :: held 3.172s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:47:44 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-337589fe-39fe-4664-ad6a-a451ac339a71 tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:44 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-337589fe-39fe-4664-ad6a-a451ac339a71 tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "cinder-quobyte-70787733-0403-4b20-93b3-8693466a7ed6" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:44 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-337589fe-39fe-4664-ad6a-a451ac339a71 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-quobyte-70787733-0403-4b20-93b3-8693466a7ed6" acquired by "delete_volume" :: waited 0.050s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:45 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaaa4b0a-e4f8-41e0-a23f-9d1f99237ec3]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:47:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-337589fe-39fe-4664-ad6a-a451ac339a71 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-70787733-0403-4b20-93b3-8693466a7ed6 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-21688a7c-08f9-4e7b-94e7-0c6a89342011 tempest-VolumesActionsTest-1241534000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-21688a7c-08f9-4e7b-94e7-0c6a89342011 tempest-VolumesActionsTest-1241534000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.037s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:45 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-21688a7c-08f9-4e7b-94e7-0c6a89342011 tempest-VolumesActionsTest-1241534000 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:47:45 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-21688a7c-08f9-4e7b-94e7-0c6a89342011 tempest-VolumesActionsTest-1241534000 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:47:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-21688a7c-08f9-4e7b-94e7-0c6a89342011 tempest-VolumesActionsTest-1241534000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-21688a7c-08f9-4e7b-94e7-0c6a89342011 tempest-VolumesActionsTest-1241534000 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-21688a7c-08f9-4e7b-94e7-0c6a89342011 tempest-VolumesActionsTest-1241534000 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.209s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:45 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-21688a7c-08f9-4e7b-94e7-0c6a89342011 tempest-VolumesActionsTest-1241534000 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:47:45 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-21688a7c-08f9-4e7b-94e7-0c6a89342011 tempest-VolumesActionsTest-1241534000 None] Deleted volume successfully. Sep 10 15:47:46 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-21688a7c-08f9-4e7b-94e7-0c6a89342011 tempest-VolumesActionsTest-1241534000 None] Lock "cinder-12855a84-a4ae-4e8a-9339-6cac8155c1b5-delete_volume" released by "delete_volume" :: held 3.728s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:47:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-337589fe-39fe-4664-ad6a-a451ac339a71 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-70787733-0403-4b20-93b3-8693466a7ed6" returned: 0 in 1.029s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-337589fe-39fe-4664-ad6a-a451ac339a71 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-70787733-0403-4b20-93b3-8693466a7ed6 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-337589fe-39fe-4664-ad6a-a451ac339a71 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-70787733-0403-4b20-93b3-8693466a7ed6" returned: 0 in 0.131s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:46 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-337589fe-39fe-4664-ad6a-a451ac339a71 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-quobyte-70787733-0403-4b20-93b3-8693466a7ed6" released by "delete_volume" :: held 1.407s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:47:46 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:46 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Flow 'volume_create_manager' (dc12122e-0d78-49e3-b901-465386ddfd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d08d43f-0b1d-4a3b-8eb1-8b4d45591ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d08d43f-0b1d-4a3b-8eb1-8b4d45591ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:47:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1140867971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb39e06c-676d-4794-9580-14184dc328a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1f49282afc4150b10dceffb5d7f6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:47:47Z,use_quota=True,user_id='d677841be9b04ed081fb21d3fa8cf52e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01cc1ab1-0486-4656-a539-cb8446dcec34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01cc1ab1-0486-4656-a539-cb8446dcec34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1321f8b-a514-4942-9779-1fb6dc0c0983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1321f8b-a514-4942-9779-1fb6dc0c0983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb39e06c-676d-4794-9580-14184dc328a7', 'volume_name': 'volume-eb39e06c-676d-4794-9580-14184dc328a7', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401dbdff-6b43-42fb-bafb-755a1e709c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401dbdff-6b43-42fb-bafb-755a1e709c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (867a8f71-7d13-482a-9b2b-47c622e71daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:47 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Volume eb39e06c-676d-4794-9580-14184dc328a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb39e06c-676d-4794-9580-14184dc328a7', 'volume_size': 1} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:47:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1140867971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb39e06c-676d-4794-9580-14184dc328a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1f49282afc4150b10dceffb5d7f6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:47:47Z,use_quota=True,user_id='d677841be9b04ed081fb21d3fa8cf52e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Creating volume eb39e06c-676d-4794-9580-14184dc328a7 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:47:47 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-eb39e06c-676d-4794-9580-14184dc328a7 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:47 devstack quobyte-client[82814]: System call of process 96986 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:47:47 devstack quobyte-client[82814]: System call of process 96986 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:47:47 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=110, name=volume-eb39e06c-676d-4794-9580-14184dc328a7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-337589fe-39fe-4664-ad6a-a451ac339a71 tempest-CreateVolumesFromSnapshotTest-786407751 None] Created reservations ['e4e5b679-2e3b-41f9-89d3-8e2811e0574e', '09147a9f-efad-4870-8d3e-2591108fc2c9', '9c1d298f-dfab-4f8e-9ac9-d68c599bf1c3', 'a6564acc-7409-4421-95c9-fe4983d1ab82'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-eb39e06c-676d-4794-9580-14184dc328a7 1073741824" returned: 0 in 0.493s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-eb39e06c-676d-4794-9580-14184dc328a7 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-337589fe-39fe-4664-ad6a-a451ac339a71 tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-337589fe-39fe-4664-ad6a-a451ac339a71 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.028s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-337589fe-39fe-4664-ad6a-a451ac339a71 tempest-CreateVolumesFromSnapshotTest-786407751 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-337589fe-39fe-4664-ad6a-a451ac339a71 tempest-CreateVolumesFromSnapshotTest-786407751 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-337589fe-39fe-4664-ad6a-a451ac339a71 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-337589fe-39fe-4664-ad6a-a451ac339a71 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:48 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-89f414dd-00d7-4cf2-b960-569c6152a280 tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "cinder-71787e71-13d9-48cf-9554-77754344fe1a-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-eb39e06c-676d-4794-9580-14184dc328a7" returned: 0 in 0.526s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:48 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] <== create_volume: return (1039ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:47:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-337589fe-39fe-4664-ad6a-a451ac339a71 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.405s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:48 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-89f414dd-00d7-4cf2-b960-569c6152a280 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-71787e71-13d9-48cf-9554-77754344fe1a-delete_volume" acquired by "delete_volume" :: waited 0.197s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:48 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-337589fe-39fe-4664-ad6a-a451ac339a71 tempest-CreateVolumesFromSnapshotTest-786407751 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:47:48 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-337589fe-39fe-4664-ad6a-a451ac339a71 tempest-CreateVolumesFromSnapshotTest-786407751 None] Deleted volume successfully. Sep 10 15:47:48 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (867a8f71-7d13-482a-9b2b-47c622e71daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb39e06c-676d-4794-9580-14184dc328a7', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:48 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd3584a-5dba-4f88-ab30-af50fdd67708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:48 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-89f414dd-00d7-4cf2-b960-569c6152a280 tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:48 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-89f414dd-00d7-4cf2-b960-569c6152a280 tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "cinder-quobyte-71787e71-13d9-48cf-9554-77754344fe1a" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:48 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Volume volume-eb39e06c-676d-4794-9580-14184dc328a7 (eb39e06c-676d-4794-9580-14184dc328a7): created successfully Sep 10 15:47:48 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd3584a-5dba-4f88-ab30-af50fdd67708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:48 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Flow 'volume_create_manager' (dc12122e-0d78-49e3-b901-465386ddfd98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:47:48 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-337589fe-39fe-4664-ad6a-a451ac339a71 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-70787733-0403-4b20-93b3-8693466a7ed6-delete_volume" released by "delete_volume" :: held 4.002s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:47:48 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-89f414dd-00d7-4cf2-b960-569c6152a280 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-quobyte-71787e71-13d9-48cf-9554-77754344fe1a" acquired by "delete_volume" :: waited 0.057s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:48 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-385b6312-fa79-4961-94f7-7c2517247ed1 tempest-VolumesActionsTest-1504098856 None] Created volume successfully. Sep 10 15:47:48 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c476a7a-4d5f-4070-ba3f-a1357a1ce2a8]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:47:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-89f414dd-00d7-4cf2-b960-569c6152a280 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-71787e71-13d9-48cf-9554-77754344fe1a {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-89f414dd-00d7-4cf2-b960-569c6152a280 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-71787e71-13d9-48cf-9554-77754344fe1a" returned: 0 in 0.518s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-89f414dd-00d7-4cf2-b960-569c6152a280 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-71787e71-13d9-48cf-9554-77754344fe1a {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:49 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0e26fa95-4e7f-41b7-86de-0b89947829b2 tempest-VolumesActionsTest-1241534000 None] Acquiring lock "cinder-eb39e06c-676d-4794-9580-14184dc328a7-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-89f414dd-00d7-4cf2-b960-569c6152a280 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-71787e71-13d9-48cf-9554-77754344fe1a" returned: 0 in 0.270s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:49 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0e26fa95-4e7f-41b7-86de-0b89947829b2 tempest-VolumesActionsTest-1241534000 None] Lock "cinder-eb39e06c-676d-4794-9580-14184dc328a7-delete_volume" acquired by "delete_volume" :: waited 0.119s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:49 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-89f414dd-00d7-4cf2-b960-569c6152a280 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-quobyte-71787e71-13d9-48cf-9554-77754344fe1a" released by "delete_volume" :: held 1.030s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:47:49 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-0e26fa95-4e7f-41b7-86de-0b89947829b2 tempest-VolumesActionsTest-1241534000 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:49 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0e26fa95-4e7f-41b7-86de-0b89947829b2 tempest-VolumesActionsTest-1241534000 None] Acquiring lock "cinder-quobyte-eb39e06c-676d-4794-9580-14184dc328a7" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:49 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0e26fa95-4e7f-41b7-86de-0b89947829b2 tempest-VolumesActionsTest-1241534000 None] Lock "cinder-quobyte-eb39e06c-676d-4794-9580-14184dc328a7" acquired by "delete_volume" :: waited 0.058s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:49 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0319c86-ed52-4242-9cbd-3fcd06890d03]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:47:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0e26fa95-4e7f-41b7-86de-0b89947829b2 tempest-VolumesActionsTest-1241534000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-eb39e06c-676d-4794-9580-14184dc328a7 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:50 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-89f414dd-00d7-4cf2-b960-569c6152a280 tempest-CreateVolumesFromSnapshotTest-786407751 None] Created reservations ['e27d489a-6e83-45ca-93a3-4da5ad885c0b', '62150154-56d0-4108-805e-ea14181b6fe7', '16b0e235-3d5c-46fc-829f-543fef1c6153', 'c60be5c6-31dd-4c29-b033-ff6118bcbe0e'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:47:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-89f414dd-00d7-4cf2-b960-569c6152a280 tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-89f414dd-00d7-4cf2-b960-569c6152a280 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:50 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-89f414dd-00d7-4cf2-b960-569c6152a280 tempest-CreateVolumesFromSnapshotTest-786407751 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:47:50 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-89f414dd-00d7-4cf2-b960-569c6152a280 tempest-CreateVolumesFromSnapshotTest-786407751 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:47:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-89f414dd-00d7-4cf2-b960-569c6152a280 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-89f414dd-00d7-4cf2-b960-569c6152a280 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0e26fa95-4e7f-41b7-86de-0b89947829b2 tempest-VolumesActionsTest-1241534000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-eb39e06c-676d-4794-9580-14184dc328a7" returned: 0 in 0.689s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0e26fa95-4e7f-41b7-86de-0b89947829b2 tempest-VolumesActionsTest-1241534000 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-eb39e06c-676d-4794-9580-14184dc328a7 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-89f414dd-00d7-4cf2-b960-569c6152a280 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.189s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:50 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-89f414dd-00d7-4cf2-b960-569c6152a280 tempest-CreateVolumesFromSnapshotTest-786407751 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:47:50 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-89f414dd-00d7-4cf2-b960-569c6152a280 tempest-CreateVolumesFromSnapshotTest-786407751 None] Deleted volume successfully. Sep 10 15:47:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0e26fa95-4e7f-41b7-86de-0b89947829b2 tempest-VolumesActionsTest-1241534000 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-eb39e06c-676d-4794-9580-14184dc328a7" returned: 0 in 0.278s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:50 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0e26fa95-4e7f-41b7-86de-0b89947829b2 tempest-VolumesActionsTest-1241534000 None] Lock "cinder-quobyte-eb39e06c-676d-4794-9580-14184dc328a7" released by "delete_volume" :: held 1.076s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:47:50 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-89f414dd-00d7-4cf2-b960-569c6152a280 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-71787e71-13d9-48cf-9554-77754344fe1a-delete_volume" released by "delete_volume" :: held 2.661s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:47:51 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-0e26fa95-4e7f-41b7-86de-0b89947829b2 tempest-VolumesActionsTest-1241534000 None] Created reservations ['b9713341-5634-4872-baf1-f15296ef2555', '1939d352-1381-495b-a6a0-bd342b0e3621', '838c5816-a028-432e-86bd-e3d97a7333c2', '383bdb8d-e11d-492a-a857-e483dedac3e4'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:47:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0e26fa95-4e7f-41b7-86de-0b89947829b2 tempest-VolumesActionsTest-1241534000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0e26fa95-4e7f-41b7-86de-0b89947829b2 tempest-VolumesActionsTest-1241534000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:51 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0e26fa95-4e7f-41b7-86de-0b89947829b2 tempest-VolumesActionsTest-1241534000 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:47:51 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0e26fa95-4e7f-41b7-86de-0b89947829b2 tempest-VolumesActionsTest-1241534000 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:47:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0e26fa95-4e7f-41b7-86de-0b89947829b2 tempest-VolumesActionsTest-1241534000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0e26fa95-4e7f-41b7-86de-0b89947829b2 tempest-VolumesActionsTest-1241534000 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:51 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-bdc00c97-3657-4f0f-9dc6-41a24e0b336a tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "cinder-0b3f1b17-a847-404e-887b-a63fbafd3e3b-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:51 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-bdc00c97-3657-4f0f-9dc6-41a24e0b336a tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-0b3f1b17-a847-404e-887b-a63fbafd3e3b-delete_volume" acquired by "delete_volume" :: waited 0.138s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0e26fa95-4e7f-41b7-86de-0b89947829b2 tempest-VolumesActionsTest-1241534000 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.477s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:51 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-0e26fa95-4e7f-41b7-86de-0b89947829b2 tempest-VolumesActionsTest-1241534000 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:47:51 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-0e26fa95-4e7f-41b7-86de-0b89947829b2 tempest-VolumesActionsTest-1241534000 None] Deleted volume successfully. Sep 10 15:47:51 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0e26fa95-4e7f-41b7-86de-0b89947829b2 tempest-VolumesActionsTest-1241534000 None] Lock "cinder-eb39e06c-676d-4794-9580-14184dc328a7-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:47:51 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-bdc00c97-3657-4f0f-9dc6-41a24e0b336a tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:51 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-bdc00c97-3657-4f0f-9dc6-41a24e0b336a tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "cinder-quobyte-0b3f1b17-a847-404e-887b-a63fbafd3e3b" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:51 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-bdc00c97-3657-4f0f-9dc6-41a24e0b336a tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-quobyte-0b3f1b17-a847-404e-887b-a63fbafd3e3b" acquired by "delete_volume" :: waited 0.014s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:51 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b2f58c-6207-478c-ab13-379678ae7876]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:47:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bdc00c97-3657-4f0f-9dc6-41a24e0b336a tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-0b3f1b17-a847-404e-887b-a63fbafd3e3b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:52 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:52 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:47:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Flow 'volume_create_manager' (579402c8-b795-48dc-bb3f-d33b0ec65a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:47:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1cd437-bb9d-49ba-95a5-12f9521df05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1cd437-bb9d-49ba-95a5-12f9521df05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1893573000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc9c5455-2ad8-4f77-8e90-5efb0ca0b249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1f49282afc4150b10dceffb5d7f6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:47:52Z,use_quota=True,user_id='d677841be9b04ed081fb21d3fa8cf52e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ef493b-a85f-434c-aaae-258e1601eae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ef493b-a85f-434c-aaae-258e1601eae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0bdaf48-30a5-45e6-9f2c-08f07e7eec4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0bdaf48-30a5-45e6-9f2c-08f07e7eec4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc9c5455-2ad8-4f77-8e90-5efb0ca0b249', 'volume_name': 'volume-dc9c5455-2ad8-4f77-8e90-5efb0ca0b249', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0cf22bb-94cf-4cbd-bc79-e26722aa619e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0cf22bb-94cf-4cbd-bc79-e26722aa619e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96320d41-85fa-416c-b69b-830d5782337a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:52 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Volume dc9c5455-2ad8-4f77-8e90-5efb0ca0b249: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc9c5455-2ad8-4f77-8e90-5efb0ca0b249', 'volume_size': 1} Sep 10 15:47:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1893573000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc9c5455-2ad8-4f77-8e90-5efb0ca0b249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1f49282afc4150b10dceffb5d7f6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:47:52Z,use_quota=True,user_id='d677841be9b04ed081fb21d3fa8cf52e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:47:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Creating volume dc9c5455-2ad8-4f77-8e90-5efb0ca0b249 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:47:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:47:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:47:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:47:52 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:47:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-dc9c5455-2ad8-4f77-8e90-5efb0ca0b249 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bdc00c97-3657-4f0f-9dc6-41a24e0b336a tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-0b3f1b17-a847-404e-887b-a63fbafd3e3b" returned: 0 in 0.851s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:52 devstack quobyte-client[82814]: System call of process 97006 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:47:52 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=111, name=volume-dc9c5455-2ad8-4f77-8e90-5efb0ca0b249, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:47:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bdc00c97-3657-4f0f-9dc6-41a24e0b336a tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-0b3f1b17-a847-404e-887b-a63fbafd3e3b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bdc00c97-3657-4f0f-9dc6-41a24e0b336a tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-0b3f1b17-a847-404e-887b-a63fbafd3e3b" returned: 0 in 0.113s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:53 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-bdc00c97-3657-4f0f-9dc6-41a24e0b336a tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-quobyte-0b3f1b17-a847-404e-887b-a63fbafd3e3b" released by "delete_volume" :: held 1.258s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:47:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-dc9c5455-2ad8-4f77-8e90-5efb0ca0b249 1073741824" returned: 0 in 0.588s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-dc9c5455-2ad8-4f77-8e90-5efb0ca0b249 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-dc9c5455-2ad8-4f77-8e90-5efb0ca0b249" returned: 0 in 0.268s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] <== create_volume: return (887ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:47:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96320d41-85fa-416c-b69b-830d5782337a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc9c5455-2ad8-4f77-8e90-5efb0ca0b249', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4eda05-12f0-40f9-9361-a177a9ee1345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:53 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Volume volume-dc9c5455-2ad8-4f77-8e90-5efb0ca0b249 (dc9c5455-2ad8-4f77-8e90-5efb0ca0b249): created successfully Sep 10 15:47:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4eda05-12f0-40f9-9361-a177a9ee1345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Flow 'volume_create_manager' (579402c8-b795-48dc-bb3f-d33b0ec65a15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:47:53 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-bdc00c97-3657-4f0f-9dc6-41a24e0b336a tempest-CreateVolumesFromSnapshotTest-786407751 None] Created reservations ['aecdf45d-d56b-4e20-b986-10e7a9a609c2', 'b631653b-13d0-488b-add5-28b38ea1d6dd', '9cbb5fc3-107b-425a-8f9c-7f05b204beea', 'cf3eb363-70e0-489e-942e-6c92ef767291'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:47:53 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-c453dd5d-a47c-4e38-a6fa-16bfe709f9c3 tempest-VolumesActionsTest-1504098856 None] Created volume successfully. Sep 10 15:47:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-bdc00c97-3657-4f0f-9dc6-41a24e0b336a tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-bdc00c97-3657-4f0f-9dc6-41a24e0b336a tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-bdc00c97-3657-4f0f-9dc6-41a24e0b336a tempest-CreateVolumesFromSnapshotTest-786407751 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:47:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-bdc00c97-3657-4f0f-9dc6-41a24e0b336a tempest-CreateVolumesFromSnapshotTest-786407751 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:47:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-bdc00c97-3657-4f0f-9dc6-41a24e0b336a tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bdc00c97-3657-4f0f-9dc6-41a24e0b336a tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bdc00c97-3657-4f0f-9dc6-41a24e0b336a tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.093s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:54 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-bdc00c97-3657-4f0f-9dc6-41a24e0b336a tempest-CreateVolumesFromSnapshotTest-786407751 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:47:54 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-bdc00c97-3657-4f0f-9dc6-41a24e0b336a tempest-CreateVolumesFromSnapshotTest-786407751 None] Deleted volume successfully. Sep 10 15:47:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-bdc00c97-3657-4f0f-9dc6-41a24e0b336a tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-0b3f1b17-a847-404e-887b-a63fbafd3e3b-delete_volume" released by "delete_volume" :: held 2.855s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:47:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0ad0ba4f-67b8-480e-a86d-e61ec7691b38 tempest-VolumesActionsTest-1241534000 None] Acquiring lock "cinder-dc9c5455-2ad8-4f77-8e90-5efb0ca0b249-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0ad0ba4f-67b8-480e-a86d-e61ec7691b38 tempest-VolumesActionsTest-1241534000 None] Lock "cinder-dc9c5455-2ad8-4f77-8e90-5efb0ca0b249-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c48ba51c-71cf-4435-83fc-ca68ed5f4e30 tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "cinder-f3dfcc32-5ba6-44f3-92d3-5355f1cc3f43-delete_snapshot" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c48ba51c-71cf-4435-83fc-ca68ed5f4e30 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-f3dfcc32-5ba6-44f3-92d3-5355f1cc3f43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:54 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-c48ba51c-71cf-4435-83fc-ca68ed5f4e30 tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c48ba51c-71cf-4435-83fc-ca68ed5f4e30 tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "cinder-quobyte-b9d09d6c-b998-4c1f-9c59-29aae3c62a30" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:54 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-0ad0ba4f-67b8-480e-a86d-e61ec7691b38 tempest-VolumesActionsTest-1241534000 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0ad0ba4f-67b8-480e-a86d-e61ec7691b38 tempest-VolumesActionsTest-1241534000 None] Acquiring lock "cinder-quobyte-dc9c5455-2ad8-4f77-8e90-5efb0ca0b249" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c48ba51c-71cf-4435-83fc-ca68ed5f4e30 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-quobyte-b9d09d6c-b998-4c1f-9c59-29aae3c62a30" acquired by "delete_snapshot" :: waited 0.052s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c48ba51c-71cf-4435-83fc-ca68ed5f4e30 tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "cinder-quobyte-f3dfcc32-5ba6-44f3-92d3-5355f1cc3f43" by "_delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c48ba51c-71cf-4435-83fc-ca68ed5f4e30 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-quobyte-f3dfcc32-5ba6-44f3-92d3-5355f1cc3f43" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:54 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-c48ba51c-71cf-4435-83fc-ca68ed5f4e30 tempest-CreateVolumesFromSnapshotTest-786407751 None] Deleting offline snapshot f3dfcc32-5ba6-44f3-92d3-5355f1cc3f43 of volume b9d09d6c-b998-4c1f-9c59-29aae3c62a30 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 15:47:54 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-c48ba51c-71cf-4435-83fc-ca68ed5f4e30 tempest-CreateVolumesFromSnapshotTest-786407751 None] snapshot_file for this snap is: volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30.f3dfcc32-5ba6-44f3-92d3-5355f1cc3f43 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 15:47:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0ad0ba4f-67b8-480e-a86d-e61ec7691b38 tempest-VolumesActionsTest-1241534000 None] Lock "cinder-quobyte-dc9c5455-2ad8-4f77-8e90-5efb0ca0b249" acquired by "delete_volume" :: waited 0.048s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:54 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b645c0-4c3b-464b-b733-cade78c9f794]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:47:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c48ba51c-71cf-4435-83fc-ca68ed5f4e30 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30.f3dfcc32-5ba6-44f3-92d3-5355f1cc3f43 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:54 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[472aeae9-62e9-4772-b503-30a70ac2538f]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:47:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0ad0ba4f-67b8-480e-a86d-e61ec7691b38 tempest-VolumesActionsTest-1241534000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-dc9c5455-2ad8-4f77-8e90-5efb0ca0b249 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c48ba51c-71cf-4435-83fc-ca68ed5f4e30 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30.f3dfcc32-5ba6-44f3-92d3-5355f1cc3f43" returned: 0 in 0.543s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:55 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-c48ba51c-71cf-4435-83fc-ca68ed5f4e30 tempest-CreateVolumesFromSnapshotTest-786407751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:47:55 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[77db9f3b-b125-412b-9dbe-5615d604c4ca]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:47:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c48ba51c-71cf-4435-83fc-ca68ed5f4e30 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0ad0ba4f-67b8-480e-a86d-e61ec7691b38 tempest-VolumesActionsTest-1241534000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-dc9c5455-2ad8-4f77-8e90-5efb0ca0b249" returned: 0 in 0.572s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0ad0ba4f-67b8-480e-a86d-e61ec7691b38 tempest-VolumesActionsTest-1241534000 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-dc9c5455-2ad8-4f77-8e90-5efb0ca0b249 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0ad0ba4f-67b8-480e-a86d-e61ec7691b38 tempest-VolumesActionsTest-1241534000 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-dc9c5455-2ad8-4f77-8e90-5efb0ca0b249" returned: 0 in 0.135s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:55 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0ad0ba4f-67b8-480e-a86d-e61ec7691b38 tempest-VolumesActionsTest-1241534000 None] Lock "cinder-quobyte-dc9c5455-2ad8-4f77-8e90-5efb0ca0b249" released by "delete_volume" :: held 1.069s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:47:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c48ba51c-71cf-4435-83fc-ca68ed5f4e30 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30" returned: 0 in 0.644s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c48ba51c-71cf-4435-83fc-ca68ed5f4e30 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30.f3dfcc32-5ba6-44f3-92d3-5355f1cc3f43 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c48ba51c-71cf-4435-83fc-ca68ed5f4e30 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30.f3dfcc32-5ba6-44f3-92d3-5355f1cc3f43" returned: 0 in 0.353s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c48ba51c-71cf-4435-83fc-ca68ed5f4e30 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30.f3dfcc32-5ba6-44f3-92d3-5355f1cc3f43 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c48ba51c-71cf-4435-83fc-ca68ed5f4e30 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30.f3dfcc32-5ba6-44f3-92d3-5355f1cc3f43" returned: 0 in 0.182s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:56 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-0ad0ba4f-67b8-480e-a86d-e61ec7691b38 tempest-VolumesActionsTest-1241534000 None] Created reservations ['f9115143-867d-4f25-8e46-21f08003a1f8', 'fd20ee5e-bf4a-4bcb-9c56-7644367dc214', '14337e65-50c6-4f6e-90a2-e351408837e0', 'e608dd43-34b5-4183-91e6-c216c6dc2a30'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:47:56 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c48ba51c-71cf-4435-83fc-ca68ed5f4e30 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-quobyte-f3dfcc32-5ba6-44f3-92d3-5355f1cc3f43" released by "_delete_snapshot" :: held 2.140s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:47:56 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c48ba51c-71cf-4435-83fc-ca68ed5f4e30 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-quobyte-b9d09d6c-b998-4c1f-9c59-29aae3c62a30" released by "delete_snapshot" :: held 2.181s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:47:57 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=116,cinder:DELETE=14,cinder:SELECT=75,cinder:INSERT=23 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:47:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0ad0ba4f-67b8-480e-a86d-e61ec7691b38 tempest-VolumesActionsTest-1241534000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0ad0ba4f-67b8-480e-a86d-e61ec7691b38 tempest-VolumesActionsTest-1241534000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:57 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0ad0ba4f-67b8-480e-a86d-e61ec7691b38 tempest-VolumesActionsTest-1241534000 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:47:57 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0ad0ba4f-67b8-480e-a86d-e61ec7691b38 tempest-VolumesActionsTest-1241534000 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:47:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0ad0ba4f-67b8-480e-a86d-e61ec7691b38 tempest-VolumesActionsTest-1241534000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0ad0ba4f-67b8-480e-a86d-e61ec7691b38 tempest-VolumesActionsTest-1241534000 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0ad0ba4f-67b8-480e-a86d-e61ec7691b38 tempest-VolumesActionsTest-1241534000 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.202s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:57 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-0ad0ba4f-67b8-480e-a86d-e61ec7691b38 tempest-VolumesActionsTest-1241534000 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:47:57 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-0ad0ba4f-67b8-480e-a86d-e61ec7691b38 tempest-VolumesActionsTest-1241534000 None] Deleted volume successfully. Sep 10 15:47:57 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-c48ba51c-71cf-4435-83fc-ca68ed5f4e30 tempest-CreateVolumesFromSnapshotTest-786407751 None] Created reservations ['abee5e9d-450f-4de2-a015-0930a0d739a4', 'c773568f-e3dd-4fe8-b9b5-a158f65531f4', '21aa274d-15db-43c4-b4dd-51a48b0702a1', '4008537f-4d7e-46a3-8d3e-ab8fe0525978'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:47:57 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0ad0ba4f-67b8-480e-a86d-e61ec7691b38 tempest-VolumesActionsTest-1241534000 None] Lock "cinder-dc9c5455-2ad8-4f77-8e90-5efb0ca0b249-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:47:57 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-c48ba51c-71cf-4435-83fc-ca68ed5f4e30 tempest-CreateVolumesFromSnapshotTest-786407751 None] Delete snapshot completed successfully. Sep 10 15:47:57 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c48ba51c-71cf-4435-83fc-ca68ed5f4e30 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-f3dfcc32-5ba6-44f3-92d3-5355f1cc3f43-delete_snapshot" released by "delete_snapshot" :: held 3.063s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:47:58 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-015ed586-e261-4205-b126-3fb8e3ac5ec5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "cinder-b9d09d6c-b998-4c1f-9c59-29aae3c62a30-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:58 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-015ed586-e261-4205-b126-3fb8e3ac5ec5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-b9d09d6c-b998-4c1f-9c59-29aae3c62a30-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:58 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-015ed586-e261-4205-b126-3fb8e3ac5ec5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:58 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-015ed586-e261-4205-b126-3fb8e3ac5ec5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "cinder-quobyte-b9d09d6c-b998-4c1f-9c59-29aae3c62a30" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:47:58 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-015ed586-e261-4205-b126-3fb8e3ac5ec5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-quobyte-b9d09d6c-b998-4c1f-9c59-29aae3c62a30" acquired by "delete_volume" :: waited 0.017s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:47:58 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec248a61-b033-4708-9c72-28faad919aee]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:47:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-015ed586-e261-4205-b126-3fb8e3ac5ec5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-015ed586-e261-4205-b126-3fb8e3ac5ec5 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30" returned: 0 in 0.608s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-015ed586-e261-4205-b126-3fb8e3ac5ec5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:59 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:47:59 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:47:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Flow 'volume_create_manager' (836fee06-cddd-4f5d-9bf0-a4867a6cce6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:47:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd7be1b-81d2-4db8-886d-91bdcbfbf18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd7be1b-81d2-4db8-886d-91bdcbfbf18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-747859796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23533383-a30d-4ed3-817f-db49efd39d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1f49282afc4150b10dceffb5d7f6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:47:59Z,use_quota=True,user_id='d677841be9b04ed081fb21d3fa8cf52e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89637204-0b78-4069-9b72-2138512bd103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89637204-0b78-4069-9b72-2138512bd103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6740e01f-aebb-4357-8bd7-af3356d2b4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6740e01f-aebb-4357-8bd7-af3356d2b4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23533383-a30d-4ed3-817f-db49efd39d56', 'volume_name': 'volume-23533383-a30d-4ed3-817f-db49efd39d56', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba3e5c2-789b-4acf-85e2-d6854ff88a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba3e5c2-789b-4acf-85e2-d6854ff88a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:47:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf5dfd2-2f8b-468d-8fd7-bb65be902bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:47:59 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Volume 23533383-a30d-4ed3-817f-db49efd39d56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23533383-a30d-4ed3-817f-db49efd39d56', 'volume_size': 1} Sep 10 15:47:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:59 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:47:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-747859796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23533383-a30d-4ed3-817f-db49efd39d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c1f49282afc4150b10dceffb5d7f6fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:47:59Z,use_quota=True,user_id='d677841be9b04ed081fb21d3fa8cf52e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:47:59 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Creating volume 23533383-a30d-4ed3-817f-db49efd39d56 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:47:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:47:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:47:59 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:47:59 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:47:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:47:59 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:47:59 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:47:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-23533383-a30d-4ed3-817f-db49efd39d56 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:47:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-015ed586-e261-4205-b126-3fb8e3ac5ec5 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b9d09d6c-b998-4c1f-9c59-29aae3c62a30" returned: 0 in 0.617s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:47:59 devstack quobyte-client[82814]: System call of process 97033 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:47:59 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=112, name=volume-23533383-a30d-4ed3-817f-db49efd39d56, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:47:59 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-015ed586-e261-4205-b126-3fb8e3ac5ec5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-quobyte-b9d09d6c-b998-4c1f-9c59-29aae3c62a30" released by "delete_volume" :: held 1.412s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:48:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-23533383-a30d-4ed3-817f-db49efd39d56 1073741824" returned: 0 in 0.587s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-23533383-a30d-4ed3-817f-db49efd39d56 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:00 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-015ed586-e261-4205-b126-3fb8e3ac5ec5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Created reservations ['717ff757-f0ca-40b8-9931-4a2a14b0edbb', 'd8d0c43d-b6b8-410b-ad30-8d01b6902070', '9d2e3c99-87c2-47a1-b18f-6cb6e0f1e5fb', 'b456affb-8d81-4831-b56c-f12316c9fa34'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:48:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-23533383-a30d-4ed3-817f-db49efd39d56" returned: 0 in 0.316s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:00 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] <== create_volume: return (928ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:48:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:48:00 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf5dfd2-2f8b-468d-8fd7-bb65be902bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23533383-a30d-4ed3-817f-db49efd39d56', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:00 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63eb36a8-478e-43c9-a9b3-2055ae438c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:00 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Volume volume-23533383-a30d-4ed3-817f-db49efd39d56 (23533383-a30d-4ed3-817f-db49efd39d56): created successfully Sep 10 15:48:00 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63eb36a8-478e-43c9-a9b3-2055ae438c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:00 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Flow 'volume_create_manager' (836fee06-cddd-4f5d-9bf0-a4867a6cce6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:48:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-015ed586-e261-4205-b126-3fb8e3ac5ec5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:48:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-015ed586-e261-4205-b126-3fb8e3ac5ec5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:48:00 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-015ed586-e261-4205-b126-3fb8e3ac5ec5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:48:00 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-015ed586-e261-4205-b126-3fb8e3ac5ec5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:48:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-015ed586-e261-4205-b126-3fb8e3ac5ec5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:48:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-015ed586-e261-4205-b126-3fb8e3ac5ec5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:00 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-4588592c-2969-4908-873c-e62001fece74 tempest-VolumesActionsTest-1504098856 None] Created volume successfully. Sep 10 15:48:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-015ed586-e261-4205-b126-3fb8e3ac5ec5 tempest-CreateVolumesFromSnapshotTest-786407751 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.283s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:00 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-015ed586-e261-4205-b126-3fb8e3ac5ec5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:48:00 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-015ed586-e261-4205-b126-3fb8e3ac5ec5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Deleted volume successfully. Sep 10 15:48:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-015ed586-e261-4205-b126-3fb8e3ac5ec5 tempest-CreateVolumesFromSnapshotTest-786407751 None] Lock "cinder-b9d09d6c-b998-4c1f-9c59-29aae3c62a30-delete_volume" released by "delete_volume" :: held 2.943s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:48:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-569a8afd-b7fd-4d10-b67e-925340844f26 tempest-VolumesActionsTest-1504098856 None] Acquiring lock "cinder-23533383-a30d-4ed3-817f-db49efd39d56-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:48:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-569a8afd-b7fd-4d10-b67e-925340844f26 tempest-VolumesActionsTest-1504098856 None] Lock "cinder-23533383-a30d-4ed3-817f-db49efd39d56-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:48:02 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-569a8afd-b7fd-4d10-b67e-925340844f26 tempest-VolumesActionsTest-1504098856 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:48:02 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-569a8afd-b7fd-4d10-b67e-925340844f26 tempest-VolumesActionsTest-1504098856 None] Acquiring lock "cinder-quobyte-23533383-a30d-4ed3-817f-db49efd39d56" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:48:02 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-569a8afd-b7fd-4d10-b67e-925340844f26 tempest-VolumesActionsTest-1504098856 None] Lock "cinder-quobyte-23533383-a30d-4ed3-817f-db49efd39d56" acquired by "delete_volume" :: waited 0.019s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:48:02 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[b274d90d-35b8-4afb-8e37-cfc0cdbc1f81]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:48:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-569a8afd-b7fd-4d10-b67e-925340844f26 tempest-VolumesActionsTest-1504098856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-23533383-a30d-4ed3-817f-db49efd39d56 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-569a8afd-b7fd-4d10-b67e-925340844f26 tempest-VolumesActionsTest-1504098856 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-23533383-a30d-4ed3-817f-db49efd39d56" returned: 0 in 0.571s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-569a8afd-b7fd-4d10-b67e-925340844f26 tempest-VolumesActionsTest-1504098856 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-23533383-a30d-4ed3-817f-db49efd39d56 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-569a8afd-b7fd-4d10-b67e-925340844f26 tempest-VolumesActionsTest-1504098856 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-23533383-a30d-4ed3-817f-db49efd39d56" returned: 0 in 0.112s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:02 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-569a8afd-b7fd-4d10-b67e-925340844f26 tempest-VolumesActionsTest-1504098856 None] Lock "cinder-quobyte-23533383-a30d-4ed3-817f-db49efd39d56" released by "delete_volume" :: held 0.874s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:48:03 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-569a8afd-b7fd-4d10-b67e-925340844f26 tempest-VolumesActionsTest-1504098856 None] Created reservations ['a8a716a1-b704-4e09-b8c0-45c3a061b43a', '5f1199e8-2087-4c6b-aa01-3a98b701a902', '1e32e1e0-f583-48f4-b0c0-cdc4f0f7f43b', 'e807eae4-7d68-4568-b80a-e49f73b4f8fc'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:48:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-569a8afd-b7fd-4d10-b67e-925340844f26 tempest-VolumesActionsTest-1504098856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:48:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-569a8afd-b7fd-4d10-b67e-925340844f26 tempest-VolumesActionsTest-1504098856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:48:03 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-569a8afd-b7fd-4d10-b67e-925340844f26 tempest-VolumesActionsTest-1504098856 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:48:03 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-569a8afd-b7fd-4d10-b67e-925340844f26 tempest-VolumesActionsTest-1504098856 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:48:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-569a8afd-b7fd-4d10-b67e-925340844f26 tempest-VolumesActionsTest-1504098856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:48:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-569a8afd-b7fd-4d10-b67e-925340844f26 tempest-VolumesActionsTest-1504098856 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-569a8afd-b7fd-4d10-b67e-925340844f26 tempest-VolumesActionsTest-1504098856 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.114s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:03 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-569a8afd-b7fd-4d10-b67e-925340844f26 tempest-VolumesActionsTest-1504098856 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:48:03 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-569a8afd-b7fd-4d10-b67e-925340844f26 tempest-VolumesActionsTest-1504098856 None] Deleted volume successfully. Sep 10 15:48:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-569a8afd-b7fd-4d10-b67e-925340844f26 tempest-VolumesActionsTest-1504098856 None] Lock "cinder-23533383-a30d-4ed3-817f-db49efd39d56-delete_volume" released by "delete_volume" :: held 2.048s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:48:05 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-03185bbf-491c-48d7-9972-f964d4868dd1 req-68700531-221f-4ef9-9053-0efbb9118b26 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:48:05 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-03185bbf-491c-48d7-9972-f964d4868dd1 req-68700531-221f-4ef9-9053-0efbb9118b26 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:48:05 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-03185bbf-491c-48d7-9972-f964d4868dd1 req-68700531-221f-4ef9-9053-0efbb9118b26 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Terminate volume connection completed successfully. Sep 10 15:48:05 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-03185bbf-491c-48d7-9972-f964d4868dd1 req-68700531-221f-4ef9-9053-0efbb9118b26 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Deleting attachment 29941e0a-706e-4450-b654-8c3d246b9bb1. {{(pid=82800) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 15:48:10 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:48:10 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:48:10 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Flow 'volume_create_manager' (b50b1ef3-93bf-4a79-bc14-360d2f1c78c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:48:10 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5290efd-6f82-4a3d-8394-92467ebed582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5290efd-6f82-4a3d-8394-92467ebed582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46013d41-ef0b-4b52-83b7-c518365efc7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15826fc9f3a14881801d6de1d665166d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:48:10Z,use_quota=True,user_id='14990010135b43848311f23df1397acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83e1a5f6-1898-452f-92d7-fb484ee1bcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83e1a5f6-1898-452f-92d7-fb484ee1bcc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8d064e-6b83-4318-b22c-000ff46c825c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8d064e-6b83-4318-b22c-000ff46c825c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '46013d41-ef0b-4b52-83b7-c518365efc7e', 'volume_name': 'volume-46013d41-ef0b-4b52-83b7-c518365efc7e', 'volume_size': 1, 'image_id': 'dfbbc63e-6724-49a4-9b6d-6f12d0e29352', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1a3faf8cb4cd85aaf061c7d348eb880b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '15826fc9f3a14881801d6de1d665166d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2d31cab8ab93ef9337ca022d9058cb2fbce4d569c421f515c866c7855caa07d5d7a15c261b33ab6d0045fcc66d6977df3e605a4a69a29d2ace410a128661f796', 'id': 'dfbbc63e-6724-49a4-9b6d-6f12d0e29352', 'created_at': datetime.datetime(2025, 9, 10, 13, 48, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 13, 48, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfbbc63e-6724-49a4-9b6d-6f12d0e29352/file', 'properties': {}}, 'image_service': }' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5cc6338-6b5c-423d-b0c2-d8b77e8e9df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5cc6338-6b5c-423d-b0c2-d8b77e8e9df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bcdb2d4-1134-4821-a191-3addbc8a6ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:11 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Volume 46013d41-ef0b-4b52-83b7-c518365efc7e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-46013d41-ef0b-4b52-83b7-c518365efc7e', 'volume_size': 1, 'image_id': 'dfbbc63e-6724-49a4-9b6d-6f12d0e29352', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1a3faf8cb4cd85aaf061c7d348eb880b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '15826fc9f3a14881801d6de1d665166d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2d31cab8ab93ef9337ca022d9058cb2fbce4d569c421f515c866c7855caa07d5d7a15c261b33ab6d0045fcc66d6977df3e605a4a69a29d2ace410a128661f796', 'id': 'dfbbc63e-6724-49a4-9b6d-6f12d0e29352', 'created_at': datetime.datetime(2025, 9, 10, 13, 48, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 13, 48, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfbbc63e-6724-49a4-9b6d-6f12d0e29352/file', 'properties': {}}, 'image_service': } Sep 10 15:48:11 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Cloning 46013d41-ef0b-4b52-83b7-c518365efc7e from image dfbbc63e-6724-49a4-9b6d-6f12d0e29352 at location (None, None). {{(pid=82800) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 15:48:11 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_b9c31s44devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=82800) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 15:48:11 devstack cinder-volume[82800]: INFO cinder.image.image_utils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Image download 0.00 MB at 0.00 MB/s Sep 10 15:48:11 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[5350e463-3db4-46c7-9105-55d86d907bce]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:48:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_b9c31s44devstack@QuobyteHD {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:12 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_b9c31s44devstack@QuobyteHD Sep 10 15:48:12 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:48:15 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Sep 10 15:48:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_b9c31s44devstack@QuobyteHD" returned: 0 in 4.421s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_b9c31s44devstack@QuobyteHD {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:16 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_b9c31s44devstack@QuobyteHD Sep 10 15:48:16 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:48:19 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Sep 10 15:48:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_b9c31s44devstack@QuobyteHD" returned: 1 in 3.320s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_b9c31s44devstack@QuobyteHD' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:48:19 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Temporary image dfbbc63e-6724-49a4-9b6d-6f12d0e29352 is fetched for user 14990010135b43848311f23df1397acb. {{(pid=82800) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 15:48:19 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de05cca-358e-4137-8f20-43169d38b1ba]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:48:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_b9c31s44devstack@QuobyteHD {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:20 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_b9c31s44devstack@QuobyteHD Sep 10 15:48:20 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:48:22 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Sep 10 15:48:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_b9c31s44devstack@QuobyteHD" returned: 0 in 2.864s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_b9c31s44devstack@QuobyteHD {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:23 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_b9c31s44devstack@QuobyteHD Sep 10 15:48:23 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:48:23 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-7ef8b8ea-b68a-4714-82ce-478bb17826db tempest-TestServerVolumeAttachmentScenario-1935644716 None] Acquiring lock "cinder-25a330be-3bf3-4879-a586-c268af018a59-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:48:23 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-7ef8b8ea-b68a-4714-82ce-478bb17826db tempest-TestServerVolumeAttachmentScenario-1935644716 None] Lock "cinder-25a330be-3bf3-4879-a586-c268af018a59-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:48:23 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=106,cinder:SELECT=78,cinder:DELETE=8,cinder:INSERT=23 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:48:24 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-7ef8b8ea-b68a-4714-82ce-478bb17826db tempest-TestServerVolumeAttachmentScenario-1935644716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:48:24 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-7ef8b8ea-b68a-4714-82ce-478bb17826db tempest-TestServerVolumeAttachmentScenario-1935644716 None] Acquiring lock "cinder-quobyte-25a330be-3bf3-4879-a586-c268af018a59" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:48:24 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-7ef8b8ea-b68a-4714-82ce-478bb17826db tempest-TestServerVolumeAttachmentScenario-1935644716 None] Lock "cinder-quobyte-25a330be-3bf3-4879-a586-c268af018a59" acquired by "delete_volume" :: waited 0.025s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:48:24 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[4817477d-4d41-4506-8025-8428133493a5]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:48:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7ef8b8ea-b68a-4714-82ce-478bb17826db tempest-TestServerVolumeAttachmentScenario-1935644716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-25a330be-3bf3-4879-a586-c268af018a59 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7ef8b8ea-b68a-4714-82ce-478bb17826db tempest-TestServerVolumeAttachmentScenario-1935644716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-25a330be-3bf3-4879-a586-c268af018a59" returned: 0 in 0.717s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7ef8b8ea-b68a-4714-82ce-478bb17826db tempest-TestServerVolumeAttachmentScenario-1935644716 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-25a330be-3bf3-4879-a586-c268af018a59 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7ef8b8ea-b68a-4714-82ce-478bb17826db tempest-TestServerVolumeAttachmentScenario-1935644716 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-25a330be-3bf3-4879-a586-c268af018a59" returned: 0 in 0.271s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:25 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-7ef8b8ea-b68a-4714-82ce-478bb17826db tempest-TestServerVolumeAttachmentScenario-1935644716 None] Lock "cinder-quobyte-25a330be-3bf3-4879-a586-c268af018a59" released by "delete_volume" :: held 1.319s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:48:25 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-7ef8b8ea-b68a-4714-82ce-478bb17826db tempest-TestServerVolumeAttachmentScenario-1935644716 None] Created reservations ['944c4c3e-8d33-4154-be16-ceb5fa763bbc', 'dd187ed7-52d9-4b03-94cc-2fbb17847152', 'f3e84773-9405-4080-812e-20683d404c0c', '824aa643-69e9-4399-abe9-13844e17cd7b'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:48:26 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Sep 10 15:48:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7ef8b8ea-b68a-4714-82ce-478bb17826db tempest-TestServerVolumeAttachmentScenario-1935644716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:48:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7ef8b8ea-b68a-4714-82ce-478bb17826db tempest-TestServerVolumeAttachmentScenario-1935644716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:48:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7ef8b8ea-b68a-4714-82ce-478bb17826db tempest-TestServerVolumeAttachmentScenario-1935644716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:48:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7ef8b8ea-b68a-4714-82ce-478bb17826db tempest-TestServerVolumeAttachmentScenario-1935644716 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:48:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7ef8b8ea-b68a-4714-82ce-478bb17826db tempest-TestServerVolumeAttachmentScenario-1935644716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:48:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7ef8b8ea-b68a-4714-82ce-478bb17826db tempest-TestServerVolumeAttachmentScenario-1935644716 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_b9c31s44devstack@QuobyteHD" returned: 1 in 3.469s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_b9c31s44devstack@QuobyteHD' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:48:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:48:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:48:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46013d41-ef0b-4b52-83b7-c518365efc7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15826fc9f3a14881801d6de1d665166d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:48:10Z,use_quota=True,user_id='14990010135b43848311f23df1397acb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:48:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Creating volume 46013d41-ef0b-4b52-83b7-c518365efc7e {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:48:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:48:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:48:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:48:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:48:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:48:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:48:26 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:48:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-46013d41-ef0b-4b52-83b7-c518365efc7e 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7ef8b8ea-b68a-4714-82ce-478bb17826db tempest-TestServerVolumeAttachmentScenario-1935644716 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.300s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:26 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-7ef8b8ea-b68a-4714-82ce-478bb17826db tempest-TestServerVolumeAttachmentScenario-1935644716 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:48:26 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=113, name=volume-46013d41-ef0b-4b52-83b7-c518365efc7e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:48:26 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-7ef8b8ea-b68a-4714-82ce-478bb17826db tempest-TestServerVolumeAttachmentScenario-1935644716 None] Deleted volume successfully. Sep 10 15:48:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-46013d41-ef0b-4b52-83b7-c518365efc7e 1073741824" returned: 0 in 0.475s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-46013d41-ef0b-4b52-83b7-c518365efc7e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-46013d41-ef0b-4b52-83b7-c518365efc7e" returned: 0 in 0.199s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:27 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] <== create_volume: return (728ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:48:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:48:27 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-7ef8b8ea-b68a-4714-82ce-478bb17826db tempest-TestServerVolumeAttachmentScenario-1935644716 None] Lock "cinder-25a330be-3bf3-4879-a586-c268af018a59-delete_volume" released by "delete_volume" :: held 3.571s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:48:27 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-1ec985ef-603f-4e2d-bd62-645bf5ccd8e3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Acquiring lock "cinder-86529936-cf4f-4c8a-b23e-1dd294743745-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:48:27 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-1ec985ef-603f-4e2d-bd62-645bf5ccd8e3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Lock "cinder-86529936-cf4f-4c8a-b23e-1dd294743745-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:48:27 devstack cinder-volume[82800]: DEBUG cinder.volume.volume_utils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Attempting download of dfbbc63e-6724-49a4-9b6d-6f12d0e29352 ((None, None)) to volume 46013d41-ef0b-4b52-83b7-c518365efc7e. {{(pid=82800) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 15:48:27 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-1ec985ef-603f-4e2d-bd62-645bf5ccd8e3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:48:27 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-1ec985ef-603f-4e2d-bd62-645bf5ccd8e3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Acquiring lock "cinder-quobyte-86529936-cf4f-4c8a-b23e-1dd294743745" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:48:27 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-1ec985ef-603f-4e2d-bd62-645bf5ccd8e3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Lock "cinder-quobyte-86529936-cf4f-4c8a-b23e-1dd294743745" acquired by "delete_volume" :: waited 0.024s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:48:27 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2828902-d3e8-4b86-845d-dccefa6e9807]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:48:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1ec985ef-603f-4e2d-bd62-645bf5ccd8e3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86529936-cf4f-4c8a-b23e-1dd294743745 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:28 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f0c8b2-147f-4265-a863-f49f696e032b]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:48:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_jiy2l3p_ {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1ec985ef-603f-4e2d-bd62-645bf5ccd8e3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86529936-cf4f-4c8a-b23e-1dd294743745" returned: 0 in 0.649s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1ec985ef-603f-4e2d-bd62-645bf5ccd8e3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86529936-cf4f-4c8a-b23e-1dd294743745 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1ec985ef-603f-4e2d-bd62-645bf5ccd8e3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86529936-cf4f-4c8a-b23e-1dd294743745" returned: 0 in 0.178s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_jiy2l3p_" returned: 0 in 0.789s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_jiy2l3p_ {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:28 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-1ec985ef-603f-4e2d-bd62-645bf5ccd8e3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Lock "cinder-quobyte-86529936-cf4f-4c8a-b23e-1dd294743745" released by "delete_volume" :: held 1.203s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:48:29 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-1ec985ef-603f-4e2d-bd62-645bf5ccd8e3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Created reservations ['315d25fe-b026-4fd2-8dca-36eed2d4457f', '40d05012-8a39-4963-863f-a02178e498be', 'cf8c59ac-6d31-46a3-aafc-b83239911202', '48cbb094-a33e-41f5-993e-b7e030232276'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:48:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_jiy2l3p_" returned: 1 in 0.570s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_jiy2l3p_' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:48:29 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9186fb-a5eb-44cf-a4f0-51e768e10db8]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:48:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_b9c31s44devstack@QuobyteHD {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:48:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:48:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:48:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:48:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:48:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:48:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.330s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:30 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:48:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_b9c31s44devstack@QuobyteHD" returned: 0 in 0.892s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_b9c31s44devstack@QuobyteHD {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-1ec985ef-603f-4e2d-bd62-645bf5ccd8e3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:48:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-1ec985ef-603f-4e2d-bd62-645bf5ccd8e3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.041s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:48:31 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-1ec985ef-603f-4e2d-bd62-645bf5ccd8e3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:48:31 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-1ec985ef-603f-4e2d-bd62-645bf5ccd8e3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:48:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-1ec985ef-603f-4e2d-bd62-645bf5ccd8e3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:48:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1ec985ef-603f-4e2d-bd62-645bf5ccd8e3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_b9c31s44devstack@QuobyteHD" returned: 1 in 0.886s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_b9c31s44devstack@QuobyteHD' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:48:31 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] dfbbc63e-6724-49a4-9b6d-6f12d0e29352 was raw, converting to raw {{(pid=82800) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 15:48:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_b9c31s44devstack@QuobyteHD /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-46013d41-ef0b-4b52-83b7-c518365efc7e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1ec985ef-603f-4e2d-bd62-645bf5ccd8e3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.261s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:31 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-1ec985ef-603f-4e2d-bd62-645bf5ccd8e3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:48:31 devstack quobyte-client[82814]: System call of process 97151 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:48:31 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-1ec985ef-603f-4e2d-bd62-645bf5ccd8e3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Deleted volume successfully. Sep 10 15:48:31 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=113, name=volume-46013d41-ef0b-4b52-83b7-c518365efc7e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:48:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_b9c31s44devstack@QuobyteHD /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-46013d41-ef0b-4b52-83b7-c518365efc7e" returned: 0 in 0.462s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:31 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dfbbc63e-6724-49a4-9b6d-6f12d0e29352_b9c31s44devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-46013d41-ef0b-4b52-83b7-c518365efc7e {{(pid=82800) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 15:48:31 devstack cinder-volume[82800]: INFO cinder.image.image_utils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Converted 0.00 MB image at 0.00 MB/s Sep 10 15:48:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-46013d41-ef0b-4b52-83b7-c518365efc7e 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:32 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-1ec985ef-603f-4e2d-bd62-645bf5ccd8e3 tempest-TestServerVolumeAttachmentScenario-1935644716 None] Lock "cinder-86529936-cf4f-4c8a-b23e-1dd294743745-delete_volume" released by "delete_volume" :: held 4.667s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:48:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-46013d41-ef0b-4b52-83b7-c518365efc7e 1G" returned: 0 in 0.509s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:32 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ae255f-3d07-4f63-adae-54582a6abfc8]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:48:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-46013d41-ef0b-4b52-83b7-c518365efc7e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-46013d41-ef0b-4b52-83b7-c518365efc7e" returned: 0 in 0.482s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-46013d41-ef0b-4b52-83b7-c518365efc7e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-46013d41-ef0b-4b52-83b7-c518365efc7e" returned: 1 in 0.501s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-46013d41-ef0b-4b52-83b7-c518365efc7e' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:48:33 devstack cinder-volume[82800]: DEBUG cinder.volume.volume_utils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Downloaded image dfbbc63e-6724-49a4-9b6d-6f12d0e29352 ((None, None)) to volume 46013d41-ef0b-4b52-83b7-c518365efc7e successfully. {{(pid=82800) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 15:48:33 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Temporary image dfbbc63e-6724-49a4-9b6d-6f12d0e29352 for user 14990010135b43848311f23df1397acb is deleted. {{(pid=82800) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 15:48:33 devstack cinder-volume[82800]: DEBUG cinder.volume.volume_utils [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Marking volume 46013d41-ef0b-4b52-83b7-c518365efc7e as bootable. {{(pid=82800) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 15:48:33 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Copying metadata from image dfbbc63e-6724-49a4-9b6d-6f12d0e29352 to 46013d41-ef0b-4b52-83b7-c518365efc7e. {{(pid=82800) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 15:48:33 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Creating volume glance metadata for volume 46013d41-ef0b-4b52-83b7-c518365efc7e backed by image dfbbc63e-6724-49a4-9b6d-6f12d0e29352 with: {'image_id': 'dfbbc63e-6724-49a4-9b6d-6f12d0e29352', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1a3faf8cb4cd85aaf061c7d348eb880b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=82800) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 15:48:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bcdb2d4-1134-4821-a191-3addbc8a6ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46013d41-ef0b-4b52-83b7-c518365efc7e', 'volume_size': 1, 'image_id': 'dfbbc63e-6724-49a4-9b6d-6f12d0e29352', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1a3faf8cb4cd85aaf061c7d348eb880b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '15826fc9f3a14881801d6de1d665166d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2d31cab8ab93ef9337ca022d9058cb2fbce4d569c421f515c866c7855caa07d5d7a15c261b33ab6d0045fcc66d6977df3e605a4a69a29d2ace410a128661f796', 'id': 'dfbbc63e-6724-49a4-9b6d-6f12d0e29352', 'created_at': datetime.datetime(2025, 9, 10, 13, 48, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 13, 48, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfbbc63e-6724-49a4-9b6d-6f12d0e29352/file', 'properties': {}}, 'image_service': }' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10baa6d-6514-4875-88a8-bd016f999195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:34 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Volume volume-46013d41-ef0b-4b52-83b7-c518365efc7e (46013d41-ef0b-4b52-83b7-c518365efc7e): created successfully Sep 10 15:48:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10baa6d-6514-4875-88a8-bd016f999195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Flow 'volume_create_manager' (b50b1ef3-93bf-4a79-bc14-360d2f1c78c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:48:34 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-f0992541-eafb-4109-a671-6106a87175ff tempest-VolumeImageDependencyTests-413230262 None] Created volume successfully. Sep 10 15:48:35 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b14c9a64-7563-41b5-a685-f1af2b7124db tempest-VolumeImageDependencyTests-413230262 None] Acquiring lock "cinder-46013d41-ef0b-4b52-83b7-c518365efc7e-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:48:35 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b14c9a64-7563-41b5-a685-f1af2b7124db tempest-VolumeImageDependencyTests-413230262 None] Lock "cinder-46013d41-ef0b-4b52-83b7-c518365efc7e-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:48:36 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-b14c9a64-7563-41b5-a685-f1af2b7124db tempest-VolumeImageDependencyTests-413230262 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:48:36 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b14c9a64-7563-41b5-a685-f1af2b7124db tempest-VolumeImageDependencyTests-413230262 None] Acquiring lock "cinder-quobyte-46013d41-ef0b-4b52-83b7-c518365efc7e" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:48:36 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b14c9a64-7563-41b5-a685-f1af2b7124db tempest-VolumeImageDependencyTests-413230262 None] Lock "cinder-quobyte-46013d41-ef0b-4b52-83b7-c518365efc7e" acquired by "delete_volume" :: waited 0.015s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:48:36 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[12226050-dc53-4439-a910-7182c015db5a]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:48:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b14c9a64-7563-41b5-a685-f1af2b7124db tempest-VolumeImageDependencyTests-413230262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-46013d41-ef0b-4b52-83b7-c518365efc7e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:36 devstack quobyte-client[82814]: System call of process 97164 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:48:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b14c9a64-7563-41b5-a685-f1af2b7124db tempest-VolumeImageDependencyTests-413230262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-46013d41-ef0b-4b52-83b7-c518365efc7e" returned: 0 in 0.651s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b14c9a64-7563-41b5-a685-f1af2b7124db tempest-VolumeImageDependencyTests-413230262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-46013d41-ef0b-4b52-83b7-c518365efc7e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:37 devstack quobyte-client[82814]: System call of process 97166 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:48:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b14c9a64-7563-41b5-a685-f1af2b7124db tempest-VolumeImageDependencyTests-413230262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-46013d41-ef0b-4b52-83b7-c518365efc7e" returned: 1 in 0.682s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b14c9a64-7563-41b5-a685-f1af2b7124db tempest-VolumeImageDependencyTests-413230262 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-46013d41-ef0b-4b52-83b7-c518365efc7e' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:48:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b14c9a64-7563-41b5-a685-f1af2b7124db tempest-VolumeImageDependencyTests-413230262 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-46013d41-ef0b-4b52-83b7-c518365efc7e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b14c9a64-7563-41b5-a685-f1af2b7124db tempest-VolumeImageDependencyTests-413230262 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-46013d41-ef0b-4b52-83b7-c518365efc7e" returned: 0 in 0.145s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:38 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b14c9a64-7563-41b5-a685-f1af2b7124db tempest-VolumeImageDependencyTests-413230262 None] Lock "cinder-quobyte-46013d41-ef0b-4b52-83b7-c518365efc7e" released by "delete_volume" :: held 1.933s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:48:38 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-b14c9a64-7563-41b5-a685-f1af2b7124db tempest-VolumeImageDependencyTests-413230262 None] Created reservations ['8fd6cc09-955e-43e4-a53c-75065ea25c31', '87a1c092-97ca-4ba2-b8ce-bb4325f274ec', 'da9c8662-499c-41a4-b2e6-b612fd3959c4', '6112f24e-3187-4260-b767-a607f3d07662'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:48:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b14c9a64-7563-41b5-a685-f1af2b7124db tempest-VolumeImageDependencyTests-413230262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:48:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b14c9a64-7563-41b5-a685-f1af2b7124db tempest-VolumeImageDependencyTests-413230262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:48:38 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b14c9a64-7563-41b5-a685-f1af2b7124db tempest-VolumeImageDependencyTests-413230262 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:48:38 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b14c9a64-7563-41b5-a685-f1af2b7124db tempest-VolumeImageDependencyTests-413230262 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:48:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b14c9a64-7563-41b5-a685-f1af2b7124db tempest-VolumeImageDependencyTests-413230262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:48:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b14c9a64-7563-41b5-a685-f1af2b7124db tempest-VolumeImageDependencyTests-413230262 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b14c9a64-7563-41b5-a685-f1af2b7124db tempest-VolumeImageDependencyTests-413230262 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.156s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:38 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-b14c9a64-7563-41b5-a685-f1af2b7124db tempest-VolumeImageDependencyTests-413230262 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:48:38 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-b14c9a64-7563-41b5-a685-f1af2b7124db tempest-VolumeImageDependencyTests-413230262 None] Deleted volume successfully. Sep 10 15:48:39 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b14c9a64-7563-41b5-a685-f1af2b7124db tempest-VolumeImageDependencyTests-413230262 None] Lock "cinder-46013d41-ef0b-4b52-83b7-c518365efc7e-delete_volume" released by "delete_volume" :: held 3.177s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:48:42 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:48:42 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:48:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Flow 'volume_create_manager' (bbfdaa5c-c3f1-4e11-b1d0-7266e82d9e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:48:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f606f90-40d2-4dbd-a47e-7e218665063b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f606f90-40d2-4dbd-a47e-7e218665063b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-606459264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74318c99-f09a-4b1f-91a9-d9bb5e2baff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a82532545094406b2142143b807e2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:48:42Z,use_quota=True,user_id='22ee13dfe2634991b27a7cbfa9f13710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (198dbc83-39ed-4851-8eb4-591a587ef908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (198dbc83-39ed-4851-8eb4-591a587ef908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba8dde0-e169-4f4b-885a-21f94ba5dc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba8dde0-e169-4f4b-885a-21f94ba5dc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74318c99-f09a-4b1f-91a9-d9bb5e2baff6', 'volume_name': 'volume-74318c99-f09a-4b1f-91a9-d9bb5e2baff6', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329c63de-ea27-46c6-af76-156f2c484cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329c63de-ea27-46c6-af76-156f2c484cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab424e0-b398-485d-b12d-1a28d21e6447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:42 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Volume 74318c99-f09a-4b1f-91a9-d9bb5e2baff6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74318c99-f09a-4b1f-91a9-d9bb5e2baff6', 'volume_size': 1} Sep 10 15:48:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:48:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:48:42 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-606459264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74318c99-f09a-4b1f-91a9-d9bb5e2baff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a82532545094406b2142143b807e2aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:48:42Z,use_quota=True,user_id='22ee13dfe2634991b27a7cbfa9f13710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:48:42 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Creating volume 74318c99-f09a-4b1f-91a9-d9bb5e2baff6 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:48:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:48:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:48:42 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:48:42 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:48:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:48:42 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:48:42 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:48:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-74318c99-f09a-4b1f-91a9-d9bb5e2baff6 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:42 devstack quobyte-client[82814]: System call of process 97173 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:48:42 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=114, name=volume-74318c99-f09a-4b1f-91a9-d9bb5e2baff6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:48:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-74318c99-f09a-4b1f-91a9-d9bb5e2baff6 1073741824" returned: 0 in 0.557s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-74318c99-f09a-4b1f-91a9-d9bb5e2baff6 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-74318c99-f09a-4b1f-91a9-d9bb5e2baff6" returned: 0 in 0.266s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:43 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] <== create_volume: return (1059ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:48:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:48:43 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab424e0-b398-485d-b12d-1a28d21e6447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74318c99-f09a-4b1f-91a9-d9bb5e2baff6', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:43 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4c2000-80ce-412b-8906-a0cda0cd6fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:44 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Volume volume-74318c99-f09a-4b1f-91a9-d9bb5e2baff6 (74318c99-f09a-4b1f-91a9-d9bb5e2baff6): created successfully Sep 10 15:48:44 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4c2000-80ce-412b-8906-a0cda0cd6fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:44 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Flow 'volume_create_manager' (bbfdaa5c-c3f1-4e11-b1d0-7266e82d9e58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:48:44 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-a74dc2fe-5541-442e-9bab-37fdca094543 tempest-VolumesMetadataTest-763872787 None] Created volume successfully. Sep 10 15:48:45 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-1ef3c8a3-3f55-44e6-8b18-c1b3d056eb12 tempest-VolumesMetadataTest-763872787 None] Acquiring lock "cinder-74318c99-f09a-4b1f-91a9-d9bb5e2baff6-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:48:45 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-1ef3c8a3-3f55-44e6-8b18-c1b3d056eb12 tempest-VolumesMetadataTest-763872787 None] Lock "cinder-74318c99-f09a-4b1f-91a9-d9bb5e2baff6-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:48:45 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-1ef3c8a3-3f55-44e6-8b18-c1b3d056eb12 tempest-VolumesMetadataTest-763872787 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:48:45 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-1ef3c8a3-3f55-44e6-8b18-c1b3d056eb12 tempest-VolumesMetadataTest-763872787 None] Acquiring lock "cinder-quobyte-74318c99-f09a-4b1f-91a9-d9bb5e2baff6" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:48:45 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-1ef3c8a3-3f55-44e6-8b18-c1b3d056eb12 tempest-VolumesMetadataTest-763872787 None] Lock "cinder-quobyte-74318c99-f09a-4b1f-91a9-d9bb5e2baff6" acquired by "delete_volume" :: waited 0.012s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:48:45 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ff18ac-d12d-4201-a886-2884cc013d00]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:48:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1ef3c8a3-3f55-44e6-8b18-c1b3d056eb12 tempest-VolumesMetadataTest-763872787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-74318c99-f09a-4b1f-91a9-d9bb5e2baff6 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1ef3c8a3-3f55-44e6-8b18-c1b3d056eb12 tempest-VolumesMetadataTest-763872787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-74318c99-f09a-4b1f-91a9-d9bb5e2baff6" returned: 0 in 0.596s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1ef3c8a3-3f55-44e6-8b18-c1b3d056eb12 tempest-VolumesMetadataTest-763872787 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-74318c99-f09a-4b1f-91a9-d9bb5e2baff6 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1ef3c8a3-3f55-44e6-8b18-c1b3d056eb12 tempest-VolumesMetadataTest-763872787 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-74318c99-f09a-4b1f-91a9-d9bb5e2baff6" returned: 0 in 0.156s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:46 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-1ef3c8a3-3f55-44e6-8b18-c1b3d056eb12 tempest-VolumesMetadataTest-763872787 None] Lock "cinder-quobyte-74318c99-f09a-4b1f-91a9-d9bb5e2baff6" released by "delete_volume" :: held 0.984s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:48:47 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-1ef3c8a3-3f55-44e6-8b18-c1b3d056eb12 tempest-VolumesMetadataTest-763872787 None] Created reservations ['f268556c-27b7-4a59-8fd5-3cee2ba2b21c', '84d8b6ba-b606-42f6-9dfe-d7625591bff3', '8f9bb4fb-3887-4327-8b98-83b9bdec6373', 'e5ccf978-ceb9-45b1-b3c6-c0e0c5a35c9d'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:48:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-1ef3c8a3-3f55-44e6-8b18-c1b3d056eb12 tempest-VolumesMetadataTest-763872787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:48:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-1ef3c8a3-3f55-44e6-8b18-c1b3d056eb12 tempest-VolumesMetadataTest-763872787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:48:47 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-1ef3c8a3-3f55-44e6-8b18-c1b3d056eb12 tempest-VolumesMetadataTest-763872787 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:48:47 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-1ef3c8a3-3f55-44e6-8b18-c1b3d056eb12 tempest-VolumesMetadataTest-763872787 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:48:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-1ef3c8a3-3f55-44e6-8b18-c1b3d056eb12 tempest-VolumesMetadataTest-763872787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:48:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1ef3c8a3-3f55-44e6-8b18-c1b3d056eb12 tempest-VolumesMetadataTest-763872787 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1ef3c8a3-3f55-44e6-8b18-c1b3d056eb12 tempest-VolumesMetadataTest-763872787 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.202s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:47 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-1ef3c8a3-3f55-44e6-8b18-c1b3d056eb12 tempest-VolumesMetadataTest-763872787 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:48:48 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-1ef3c8a3-3f55-44e6-8b18-c1b3d056eb12 tempest-VolumesMetadataTest-763872787 None] Deleted volume successfully. Sep 10 15:48:48 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-1ef3c8a3-3f55-44e6-8b18-c1b3d056eb12 tempest-VolumesMetadataTest-763872787 None] Lock "cinder-74318c99-f09a-4b1f-91a9-d9bb5e2baff6-delete_volume" released by "delete_volume" :: held 2.772s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:48:52 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:48:52 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:48:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Flow 'volume_create_manager' (b95b8dd1-ed0e-4431-a7d1-cb22b9dff8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:48:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4fa97ab-2640-4fc4-a66e-49a5d5540c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4fa97ab-2640-4fc4-a66e-49a5d5540c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1529961382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e3cd17f-a603-44a5-957a-3cf4e9d38df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527871c104414db1b6394453cce5c3fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:48:53Z,use_quota=True,user_id='72efde5ad51e455ea8f974e724b52b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ac947c-3421-43af-a97c-be535d355749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ac947c-3421-43af-a97c-be535d355749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f74204-fd39-49a7-a0c8-8a1a2461e63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f74204-fd39-49a7-a0c8-8a1a2461e63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e3cd17f-a603-44a5-957a-3cf4e9d38df5', 'volume_name': 'volume-3e3cd17f-a603-44a5-957a-3cf4e9d38df5', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e00d4ff8-bd95-4b9c-a6d3-a0b031dc9d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e00d4ff8-bd95-4b9c-a6d3-a0b031dc9d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e35e7e-efc9-4ab6-bad1-5e8800a48846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:53 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Volume 3e3cd17f-a603-44a5-957a-3cf4e9d38df5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e3cd17f-a603-44a5-957a-3cf4e9d38df5', 'volume_size': 1} Sep 10 15:48:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:48:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:48:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1529961382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e3cd17f-a603-44a5-957a-3cf4e9d38df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527871c104414db1b6394453cce5c3fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:48:53Z,use_quota=True,user_id='72efde5ad51e455ea8f974e724b52b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:48:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Creating volume 3e3cd17f-a603-44a5-957a-3cf4e9d38df5 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:48:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:48:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:48:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:48:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:48:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:48:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:48:53 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:48:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3e3cd17f-a603-44a5-957a-3cf4e9d38df5 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:53 devstack quobyte-client[82814]: System call of process 97219 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:48:53 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=115, name=volume-3e3cd17f-a603-44a5-957a-3cf4e9d38df5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:48:54 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:48:54 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:48:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Flow 'volume_create_manager' (cc58387a-d0c3-4f16-8071-86d92689a2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:48:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77772dba-e531-4006-b1c4-6f00c41f997b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3e3cd17f-a603-44a5-957a-3cf4e9d38df5 1073741824" returned: 0 in 0.960s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77772dba-e531-4006-b1c4-6f00c41f997b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-187743390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b3b03ce-40d0-409e-87aa-51e49753e9d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527871c104414db1b6394453cce5c3fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:48:53Z,use_quota=True,user_id='72efde5ad51e455ea8f974e724b52b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46e8392-563a-4bfd-8be3-9309fa23fdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46e8392-563a-4bfd-8be3-9309fa23fdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77978b17-9f7c-405b-9cc3-05461311fbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77978b17-9f7c-405b-9cc3-05461311fbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b3b03ce-40d0-409e-87aa-51e49753e9d0', 'volume_name': 'volume-2b3b03ce-40d0-409e-87aa-51e49753e9d0', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (193b5a81-cd28-43d7-9475-971dcc095880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (193b5a81-cd28-43d7-9475-971dcc095880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b10cb505-6e13-4810-9396-43bd06b0c723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:54 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Volume 2b3b03ce-40d0-409e-87aa-51e49753e9d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b3b03ce-40d0-409e-87aa-51e49753e9d0', 'volume_size': 1} Sep 10 15:48:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:48:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3e3cd17f-a603-44a5-957a-3cf4e9d38df5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:54 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:48:54 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:48:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Flow 'volume_create_manager' (560a109c-3605-4200-837d-e94d31cdb7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:48:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ebddec-bcf6-45ca-8320-814da1943d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ebddec-bcf6-45ca-8320-814da1943d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1336258462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805812c2-597b-48d9-be3d-641e7dc26659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527871c104414db1b6394453cce5c3fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:48:54Z,use_quota=True,user_id='72efde5ad51e455ea8f974e724b52b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d888ae64-36ca-42e5-966c-6a0199a2d191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d888ae64-36ca-42e5-966c-6a0199a2d191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff57c593-6f63-4b6c-aea9-c07a477658bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff57c593-6f63-4b6c-aea9-c07a477658bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '805812c2-597b-48d9-be3d-641e7dc26659', 'volume_name': 'volume-805812c2-597b-48d9-be3d-641e7dc26659', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b0e04f-1331-4fb6-ba48-d45170ce049a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b0e04f-1331-4fb6-ba48-d45170ce049a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:54 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84c3d152-ffb8-4a0a-b7ff-4096eba6a5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:54 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Volume 805812c2-597b-48d9-be3d-641e7dc26659: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-805812c2-597b-48d9-be3d-641e7dc26659', 'volume_size': 1} Sep 10 15:48:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:48:54 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:48:54 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Flow 'volume_create_manager' (a7b67555-f84b-4279-8e45-2a01c3cacb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd3a3f1-afba-4443-9de9-eaa9930f9319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3e3cd17f-a603-44a5-957a-3cf4e9d38df5" returned: 0 in 1.042s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd3a3f1-afba-4443-9de9-eaa9930f9319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1434338809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cfb7ffa-8d61-4e66-ad38-28ae9071bbae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527871c104414db1b6394453cce5c3fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:48:54Z,use_quota=True,user_id='72efde5ad51e455ea8f974e724b52b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5cc730b-655e-443e-93f0-023089f0d75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5cc730b-655e-443e-93f0-023089f0d75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b096f5-f8ce-481f-9e92-6460d0000ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b096f5-f8ce-481f-9e92-6460d0000ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cfb7ffa-8d61-4e66-ad38-28ae9071bbae', 'volume_name': 'volume-7cfb7ffa-8d61-4e66-ad38-28ae9071bbae', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81c8bf5-0d25-47da-8241-41c43b1d5a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81c8bf5-0d25-47da-8241-41c43b1d5a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373665c5-44d7-4a18-bc12-194aa157c298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:55 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Volume 7cfb7ffa-8d61-4e66-ad38-28ae9071bbae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cfb7ffa-8d61-4e66-ad38-28ae9071bbae', 'volume_size': 1} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] <== create_volume: return (2134ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.142s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.104s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-187743390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b3b03ce-40d0-409e-87aa-51e49753e9d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527871c104414db1b6394453cce5c3fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:48:53Z,use_quota=True,user_id='72efde5ad51e455ea8f974e724b52b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Creating volume 2b3b03ce-40d0-409e-87aa-51e49753e9d0 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:48:55 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b3b03ce-40d0-409e-87aa-51e49753e9d0 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:55 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=116, name=volume-2b3b03ce-40d0-409e-87aa-51e49753e9d0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e35e7e-efc9-4ab6-bad1-5e8800a48846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e3cd17f-a603-44a5-957a-3cf4e9d38df5', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42cfd93-1395-4fc6-92b8-3d30c0b425c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:55 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Flow 'volume_create_manager' (c8ed00b6-17cf-4cca-bc1c-3665737c2e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a17cfcf9-2044-4875-8ead-27d54deef215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:55 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Flow 'volume_create_manager' (0360c397-952d-46ed-b74e-d94e99b98197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:48:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f199d98-778b-4bee-b87f-9987368673e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:56 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Volume volume-3e3cd17f-a603-44a5-957a-3cf4e9d38df5 (3e3cd17f-a603-44a5-957a-3cf4e9d38df5): created successfully Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42cfd93-1395-4fc6-92b8-3d30c0b425c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Flow 'volume_create_manager' (b95b8dd1-ed0e-4431-a7d1-cb22b9dff8b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b3b03ce-40d0-409e-87aa-51e49753e9d0 1073741824" returned: 0 in 0.671s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b3b03ce-40d0-409e-87aa-51e49753e9d0 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a17cfcf9-2044-4875-8ead-27d54deef215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-111866262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c005547-ad47-41f5-894a-aa28751a411c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98f385e0f5924e5ab83bbc0be3c7ad00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:48:55Z,use_quota=True,user_id='1d13f09c33a848e180c34f95d44622ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d52c863e-fd8c-4786-8b21-75665f3327dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d52c863e-fd8c-4786-8b21-75665f3327dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef702f6-fe91-4e5c-9e70-e25f6e74e1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef702f6-fe91-4e5c-9e70-e25f6e74e1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c005547-ad47-41f5-894a-aa28751a411c', 'volume_name': 'volume-9c005547-ad47-41f5-894a-aa28751a411c', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4a839d-f9cf-4e5f-b436-435e355587f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b4a839d-f9cf-4e5f-b436-435e355587f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c848b8-31fe-423b-8573-5d87511df5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:56 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Volume 9c005547-ad47-41f5-894a-aa28751a411c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c005547-ad47-41f5-894a-aa28751a411c', 'volume_size': 1} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f199d98-778b-4bee-b87f-9987368673e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-374799056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e5a7066-5f80-4fc2-af1e-1d9107f3b766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527871c104414db1b6394453cce5c3fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:48:55Z,use_quota=True,user_id='72efde5ad51e455ea8f974e724b52b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f832319-40c8-4440-b8a9-7efd1d354525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f832319-40c8-4440-b8a9-7efd1d354525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ef090da-93e1-4e97-b6b5-f14e9226a6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ef090da-93e1-4e97-b6b5-f14e9226a6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e5a7066-5f80-4fc2-af1e-1d9107f3b766', 'volume_name': 'volume-6e5a7066-5f80-4fc2-af1e-1d9107f3b766', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (529f032a-ea78-433a-bcb7-9b83790c8039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (529f032a-ea78-433a-bcb7-9b83790c8039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8a70c2-43ea-457e-adb2-aac95b50b768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:56 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Volume 6e5a7066-5f80-4fc2-af1e-1d9107f3b766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e5a7066-5f80-4fc2-af1e-1d9107f3b766', 'volume_size': 1} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:48:56 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-01603b01-3ff8-4134-abe8-cce58b5ae5dc tempest-CreateVolumesFromImageTest-1289425725 None] Created volume successfully. Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b3b03ce-40d0-409e-87aa-51e49753e9d0" returned: 0 in 0.443s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] <== create_volume: return (1139ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.548s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1336258462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805812c2-597b-48d9-be3d-641e7dc26659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527871c104414db1b6394453cce5c3fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:48:54Z,use_quota=True,user_id='72efde5ad51e455ea8f974e724b52b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Creating volume 805812c2-597b-48d9-be3d-641e7dc26659 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:48:56 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-805812c2-597b-48d9-be3d-641e7dc26659 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:56 devstack quobyte-client[82814]: System call of process 97229 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:48:56 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=117, name=volume-805812c2-597b-48d9-be3d-641e7dc26659, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b10cb505-6e13-4810-9396-43bd06b0c723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b3b03ce-40d0-409e-87aa-51e49753e9d0', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e974d35-6cee-408b-b0d3-0577f6a8e029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-805812c2-597b-48d9-be3d-641e7dc26659 1073741824" returned: 0 in 0.443s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-805812c2-597b-48d9-be3d-641e7dc26659 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:57 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Volume volume-2b3b03ce-40d0-409e-87aa-51e49753e9d0 (2b3b03ce-40d0-409e-87aa-51e49753e9d0): created successfully Sep 10 15:48:57 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e974d35-6cee-408b-b0d3-0577f6a8e029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:57 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Flow 'volume_create_manager' (cc58387a-d0c3-4f16-8071-86d92689a2b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:48:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-805812c2-597b-48d9-be3d-641e7dc26659" returned: 0 in 0.339s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:57 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] <== create_volume: return (804ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:48:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:48:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.020s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:48:57 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1434338809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cfb7ffa-8d61-4e66-ad38-28ae9071bbae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527871c104414db1b6394453cce5c3fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:48:54Z,use_quota=True,user_id='72efde5ad51e455ea8f974e724b52b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:48:57 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Creating volume 7cfb7ffa-8d61-4e66-ad38-28ae9071bbae {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:48:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:48:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:48:57 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:48:57 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:48:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:48:57 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:48:57 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:48:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7cfb7ffa-8d61-4e66-ad38-28ae9071bbae 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:57 devstack quobyte-client[82814]: System call of process 97233 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:48:57 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=118, name=volume-7cfb7ffa-8d61-4e66-ad38-28ae9071bbae, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:48:57 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-54dbd764-0326-4c59-ad7c-d32a8b4b037f tempest-CreateVolumesFromImageTest-1289425725 None] Created volume successfully. Sep 10 15:48:57 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84c3d152-ffb8-4a0a-b7ff-4096eba6a5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-805812c2-597b-48d9-be3d-641e7dc26659', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:57 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95eec746-6744-4fa8-a5ea-59a82d304b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7cfb7ffa-8d61-4e66-ad38-28ae9071bbae 1073741824" returned: 0 in 0.498s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7cfb7ffa-8d61-4e66-ad38-28ae9071bbae {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:58 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Volume volume-805812c2-597b-48d9-be3d-641e7dc26659 (805812c2-597b-48d9-be3d-641e7dc26659): created successfully Sep 10 15:48:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95eec746-6744-4fa8-a5ea-59a82d304b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Flow 'volume_create_manager' (560a109c-3605-4200-837d-e94d31cdb7e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:48:58 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:DELETE=7,cinder:UPDATE=67,cinder:SELECT=52,cinder:INSERT=27 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:48:58 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-f8525737-6717-4783-a298-c1517ddba4d9 tempest-CreateVolumesFromImageTest-1289425725 None] Created volume successfully. Sep 10 15:48:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7cfb7ffa-8d61-4e66-ad38-28ae9071bbae" returned: 0 in 0.382s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] <== create_volume: return (907ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:48:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:48:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.907s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:48:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-111866262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c005547-ad47-41f5-894a-aa28751a411c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98f385e0f5924e5ab83bbc0be3c7ad00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:48:55Z,use_quota=True,user_id='1d13f09c33a848e180c34f95d44622ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:48:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Creating volume 9c005547-ad47-41f5-894a-aa28751a411c {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:48:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:48:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:48:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:48:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:48:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:48:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:48:58 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:48:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9c005547-ad47-41f5-894a-aa28751a411c 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:58 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=119, name=volume-9c005547-ad47-41f5-894a-aa28751a411c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:48:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373665c5-44d7-4a18-bc12-194aa157c298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cfb7ffa-8d61-4e66-ad38-28ae9071bbae', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c49343fb-0061-4505-b768-e4eb56269936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9c005547-ad47-41f5-894a-aa28751a411c 1073741824" returned: 0 in 0.502s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9c005547-ad47-41f5-894a-aa28751a411c {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:58 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Volume volume-7cfb7ffa-8d61-4e66-ad38-28ae9071bbae (7cfb7ffa-8d61-4e66-ad38-28ae9071bbae): created successfully Sep 10 15:48:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c49343fb-0061-4505-b768-e4eb56269936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Flow 'volume_create_manager' (a7b67555-f84b-4279-8e45-2a01c3cacb77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:48:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9c005547-ad47-41f5-894a-aa28751a411c" returned: 0 in 0.312s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:59 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] <== create_volume: return (837ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:48:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:48:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.721s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:48:59 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:48:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-374799056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e5a7066-5f80-4fc2-af1e-1d9107f3b766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527871c104414db1b6394453cce5c3fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:48:55Z,use_quota=True,user_id='72efde5ad51e455ea8f974e724b52b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:48:59 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Creating volume 6e5a7066-5f80-4fc2-af1e-1d9107f3b766 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:48:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:48:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:48:59 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:48:59 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:48:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:48:59 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:48:59 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:48:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6e5a7066-5f80-4fc2-af1e-1d9107f3b766 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:59 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=120, name=volume-6e5a7066-5f80-4fc2-af1e-1d9107f3b766, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:48:59 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-2d9f62e2-229d-4f94-809c-5612400236d8 tempest-CreateVolumesFromImageTest-1289425725 None] Created volume successfully. Sep 10 15:48:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c848b8-31fe-423b-8573-5d87511df5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c005547-ad47-41f5-894a-aa28751a411c', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a7c546-2e67-41d2-84de-66645e2907d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:48:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6e5a7066-5f80-4fc2-af1e-1d9107f3b766 1073741824" returned: 0 in 0.471s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6e5a7066-5f80-4fc2-af1e-1d9107f3b766 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:48:59 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Volume volume-9c005547-ad47-41f5-894a-aa28751a411c (9c005547-ad47-41f5-894a-aa28751a411c): created successfully Sep 10 15:48:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a7c546-2e67-41d2-84de-66645e2907d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:48:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Flow 'volume_create_manager' (c8ed00b6-17cf-4cca-bc1c-3665737c2e7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:48:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6e5a7066-5f80-4fc2-af1e-1d9107f3b766" returned: 0 in 0.338s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:48:59 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] <== create_volume: return (833ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:48:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:49:00 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-bafd7d69-205e-42e8-981c-4b9785fdb7ff tempest-VolumesTransfersV355Test-2038652961 None] Created volume successfully. Sep 10 15:49:00 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8a70c2-43ea-457e-adb2-aac95b50b768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e5a7066-5f80-4fc2-af1e-1d9107f3b766', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:00 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec3d849-7ca7-445a-add7-78ff759ae82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:00 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Volume volume-6e5a7066-5f80-4fc2-af1e-1d9107f3b766 (6e5a7066-5f80-4fc2-af1e-1d9107f3b766): created successfully Sep 10 15:49:00 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec3d849-7ca7-445a-add7-78ff759ae82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:00 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Flow 'volume_create_manager' (0360c397-952d-46ed-b74e-d94e99b98197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:49:00 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-74f39e40-4028-4db0-8a28-d56ae1f53f79 tempest-CreateVolumesFromImageTest-1289425725 None] Created volume successfully. Sep 10 15:49:01 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-4118ceae-c12a-4660-afd0-60c8a1f60830 tempest-VolumesTransfersV355Test-1003448207 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:49:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-38cab34c-f944-4695-aefb-d1e238d4cda9 tempest-CreateVolumesFromImageTest-1289425725 None] Acquiring lock "cinder-6e5a7066-5f80-4fc2-af1e-1d9107f3b766-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:49:01 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-4118ceae-c12a-4660-afd0-60c8a1f60830 tempest-VolumesTransfersV355Test-1003448207 None] Transfer volume completed successfully. Sep 10 15:49:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-38cab34c-f944-4695-aefb-d1e238d4cda9 tempest-CreateVolumesFromImageTest-1289425725 None] Lock "cinder-6e5a7066-5f80-4fc2-af1e-1d9107f3b766-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:49:01 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-38cab34c-f944-4695-aefb-d1e238d4cda9 tempest-CreateVolumesFromImageTest-1289425725 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:49:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-38cab34c-f944-4695-aefb-d1e238d4cda9 tempest-CreateVolumesFromImageTest-1289425725 None] Acquiring lock "cinder-quobyte-6e5a7066-5f80-4fc2-af1e-1d9107f3b766" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:49:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-38cab34c-f944-4695-aefb-d1e238d4cda9 tempest-CreateVolumesFromImageTest-1289425725 None] Lock "cinder-quobyte-6e5a7066-5f80-4fc2-af1e-1d9107f3b766" acquired by "delete_volume" :: waited 0.017s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:49:01 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aeeee92-2341-4cee-bc2a-a70eab82a253]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:49:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-38cab34c-f944-4695-aefb-d1e238d4cda9 tempest-CreateVolumesFromImageTest-1289425725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6e5a7066-5f80-4fc2-af1e-1d9107f3b766 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-38cab34c-f944-4695-aefb-d1e238d4cda9 tempest-CreateVolumesFromImageTest-1289425725 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6e5a7066-5f80-4fc2-af1e-1d9107f3b766" returned: 0 in 0.449s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-38cab34c-f944-4695-aefb-d1e238d4cda9 tempest-CreateVolumesFromImageTest-1289425725 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6e5a7066-5f80-4fc2-af1e-1d9107f3b766 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-38cab34c-f944-4695-aefb-d1e238d4cda9 tempest-CreateVolumesFromImageTest-1289425725 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6e5a7066-5f80-4fc2-af1e-1d9107f3b766" returned: 0 in 0.121s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:02 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-38cab34c-f944-4695-aefb-d1e238d4cda9 tempest-CreateVolumesFromImageTest-1289425725 None] Lock "cinder-quobyte-6e5a7066-5f80-4fc2-af1e-1d9107f3b766" released by "delete_volume" :: held 0.720s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:49:02 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-7d71bdb2-277b-4eb4-b679-4b88b209b59a tempest-VolumesTransfersV355Test-1365388337 None] Acquiring lock "cinder-9c005547-ad47-41f5-894a-aa28751a411c-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:49:02 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-7d71bdb2-277b-4eb4-b679-4b88b209b59a tempest-VolumesTransfersV355Test-1365388337 None] Lock "cinder-9c005547-ad47-41f5-894a-aa28751a411c-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:49:02 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-7d71bdb2-277b-4eb4-b679-4b88b209b59a tempest-VolumesTransfersV355Test-1365388337 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:49:02 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-7d71bdb2-277b-4eb4-b679-4b88b209b59a tempest-VolumesTransfersV355Test-1365388337 None] Acquiring lock "cinder-quobyte-9c005547-ad47-41f5-894a-aa28751a411c" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:49:02 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-7d71bdb2-277b-4eb4-b679-4b88b209b59a tempest-VolumesTransfersV355Test-1365388337 None] Lock "cinder-quobyte-9c005547-ad47-41f5-894a-aa28751a411c" acquired by "delete_volume" :: waited 0.011s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:49:02 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-38cab34c-f944-4695-aefb-d1e238d4cda9 tempest-CreateVolumesFromImageTest-1289425725 None] Created reservations ['2dce70be-e32d-4cad-8694-2d9f1ea8587b', '4998f022-59e8-4815-9de3-6286a155d21f', 'af918703-7c6b-4e8f-a5ac-4965655ef6e4', '67a92f8b-8873-4464-91a1-2ea231a1b677'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:49:02 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[786446dd-2939-4aab-9e16-f75876136b92]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:49:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7d71bdb2-277b-4eb4-b679-4b88b209b59a tempest-VolumesTransfersV355Test-1365388337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9c005547-ad47-41f5-894a-aa28751a411c {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-38cab34c-f944-4695-aefb-d1e238d4cda9 tempest-CreateVolumesFromImageTest-1289425725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:49:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-38cab34c-f944-4695-aefb-d1e238d4cda9 tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:49:03 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-38cab34c-f944-4695-aefb-d1e238d4cda9 tempest-CreateVolumesFromImageTest-1289425725 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:49:03 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-38cab34c-f944-4695-aefb-d1e238d4cda9 tempest-CreateVolumesFromImageTest-1289425725 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:49:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-38cab34c-f944-4695-aefb-d1e238d4cda9 tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:49:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-38cab34c-f944-4695-aefb-d1e238d4cda9 tempest-CreateVolumesFromImageTest-1289425725 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7d71bdb2-277b-4eb4-b679-4b88b209b59a tempest-VolumesTransfersV355Test-1365388337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9c005547-ad47-41f5-894a-aa28751a411c" returned: 0 in 0.619s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7d71bdb2-277b-4eb4-b679-4b88b209b59a tempest-VolumesTransfersV355Test-1365388337 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9c005547-ad47-41f5-894a-aa28751a411c {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-38cab34c-f944-4695-aefb-d1e238d4cda9 tempest-CreateVolumesFromImageTest-1289425725 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.207s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:03 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-38cab34c-f944-4695-aefb-d1e238d4cda9 tempest-CreateVolumesFromImageTest-1289425725 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:49:03 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-38cab34c-f944-4695-aefb-d1e238d4cda9 tempest-CreateVolumesFromImageTest-1289425725 None] Deleted volume successfully. Sep 10 15:49:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c3e4f889-eae6-4091-9c1b-93a40fbf4f51 tempest-CreateVolumesFromImageTest-1289425725 None] Acquiring lock "cinder-7cfb7ffa-8d61-4e66-ad38-28ae9071bbae-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:49:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7d71bdb2-277b-4eb4-b679-4b88b209b59a tempest-VolumesTransfersV355Test-1365388337 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9c005547-ad47-41f5-894a-aa28751a411c" returned: 0 in 0.491s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c3e4f889-eae6-4091-9c1b-93a40fbf4f51 tempest-CreateVolumesFromImageTest-1289425725 None] Lock "cinder-7cfb7ffa-8d61-4e66-ad38-28ae9071bbae-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:49:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-7d71bdb2-277b-4eb4-b679-4b88b209b59a tempest-VolumesTransfersV355Test-1365388337 None] Lock "cinder-quobyte-9c005547-ad47-41f5-894a-aa28751a411c" released by "delete_volume" :: held 1.221s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:49:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-38cab34c-f944-4695-aefb-d1e238d4cda9 tempest-CreateVolumesFromImageTest-1289425725 None] Lock "cinder-6e5a7066-5f80-4fc2-af1e-1d9107f3b766-delete_volume" released by "delete_volume" :: held 2.552s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:49:04 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-c3e4f889-eae6-4091-9c1b-93a40fbf4f51 tempest-CreateVolumesFromImageTest-1289425725 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:49:04 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c3e4f889-eae6-4091-9c1b-93a40fbf4f51 tempest-CreateVolumesFromImageTest-1289425725 None] Acquiring lock "cinder-quobyte-7cfb7ffa-8d61-4e66-ad38-28ae9071bbae" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:49:04 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c3e4f889-eae6-4091-9c1b-93a40fbf4f51 tempest-CreateVolumesFromImageTest-1289425725 None] Lock "cinder-quobyte-7cfb7ffa-8d61-4e66-ad38-28ae9071bbae" acquired by "delete_volume" :: waited 0.021s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:49:04 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df0fafb-f6b0-4487-833f-73610cc4ffd4]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:49:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c3e4f889-eae6-4091-9c1b-93a40fbf4f51 tempest-CreateVolumesFromImageTest-1289425725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7cfb7ffa-8d61-4e66-ad38-28ae9071bbae {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:04 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-7d71bdb2-277b-4eb4-b679-4b88b209b59a tempest-VolumesTransfersV355Test-1365388337 None] Created reservations ['28602a9c-0e22-4cb2-9671-3d5d06943e3a', '72d0d9ae-05d6-40d6-a4bf-1d668bbb5bfb', 'a7692c79-785d-4d59-97b8-4f1ed3239598', '213fe197-9249-43f3-8d19-6c3f27f5c452'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:49:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c3e4f889-eae6-4091-9c1b-93a40fbf4f51 tempest-CreateVolumesFromImageTest-1289425725 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7cfb7ffa-8d61-4e66-ad38-28ae9071bbae" returned: 0 in 0.555s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c3e4f889-eae6-4091-9c1b-93a40fbf4f51 tempest-CreateVolumesFromImageTest-1289425725 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7cfb7ffa-8d61-4e66-ad38-28ae9071bbae {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c3e4f889-eae6-4091-9c1b-93a40fbf4f51 tempest-CreateVolumesFromImageTest-1289425725 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7cfb7ffa-8d61-4e66-ad38-28ae9071bbae" returned: 0 in 0.327s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:05 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c3e4f889-eae6-4091-9c1b-93a40fbf4f51 tempest-CreateVolumesFromImageTest-1289425725 None] Lock "cinder-quobyte-7cfb7ffa-8d61-4e66-ad38-28ae9071bbae" released by "delete_volume" :: held 1.028s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:49:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7d71bdb2-277b-4eb4-b679-4b88b209b59a tempest-VolumesTransfersV355Test-1365388337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:49:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7d71bdb2-277b-4eb4-b679-4b88b209b59a tempest-VolumesTransfersV355Test-1365388337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:49:05 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7d71bdb2-277b-4eb4-b679-4b88b209b59a tempest-VolumesTransfersV355Test-1365388337 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:49:05 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7d71bdb2-277b-4eb4-b679-4b88b209b59a tempest-VolumesTransfersV355Test-1365388337 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:49:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7d71bdb2-277b-4eb4-b679-4b88b209b59a tempest-VolumesTransfersV355Test-1365388337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:49:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7d71bdb2-277b-4eb4-b679-4b88b209b59a tempest-VolumesTransfersV355Test-1365388337 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7d71bdb2-277b-4eb4-b679-4b88b209b59a tempest-VolumesTransfersV355Test-1365388337 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.273s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:05 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-7d71bdb2-277b-4eb4-b679-4b88b209b59a tempest-VolumesTransfersV355Test-1365388337 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:49:05 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-7d71bdb2-277b-4eb4-b679-4b88b209b59a tempest-VolumesTransfersV355Test-1365388337 None] Deleted volume successfully. Sep 10 15:49:05 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-c3e4f889-eae6-4091-9c1b-93a40fbf4f51 tempest-CreateVolumesFromImageTest-1289425725 None] Created reservations ['0092ab1d-01b9-46fd-83c4-701572f262da', '7d24c681-443f-449e-934d-207d1c81b37f', '9b7a3a7a-0074-471c-af69-c6866e88f564', 'faa8a1ad-77a0-488c-b6f1-2931b35240a2'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:49:05 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:49:05 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:49:05 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Flow 'volume_create_manager' (6fa79588-1f4f-4919-817f-658fb541da3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:49:05 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a398df-28ee-4519-8aee-50fce51f3eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:05 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-7d71bdb2-277b-4eb4-b679-4b88b209b59a tempest-VolumesTransfersV355Test-1365388337 None] Lock "cinder-9c005547-ad47-41f5-894a-aa28751a411c-delete_volume" released by "delete_volume" :: held 3.559s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a398df-28ee-4519-8aee-50fce51f3eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-429143258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c65743-b8f8-4651-b3c3-6effbf3cfaba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98f385e0f5924e5ab83bbc0be3c7ad00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:49:06Z,use_quota=True,user_id='1d13f09c33a848e180c34f95d44622ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99a38a9b-5b8c-4a92-a6fa-d926bcd6837c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99a38a9b-5b8c-4a92-a6fa-d926bcd6837c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b05aaf6-7bee-4620-a291-f617f57aebb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b05aaf6-7bee-4620-a291-f617f57aebb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9c65743-b8f8-4651-b3c3-6effbf3cfaba', 'volume_name': 'volume-f9c65743-b8f8-4651-b3c3-6effbf3cfaba', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d51100bb-2588-4306-9061-6aa708859cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d51100bb-2588-4306-9061-6aa708859cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdeb91dd-9795-4bbf-bc5b-2b4bdfa4eac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:06 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Volume f9c65743-b8f8-4651-b3c3-6effbf3cfaba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9c65743-b8f8-4651-b3c3-6effbf3cfaba', 'volume_size': 1} Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-429143258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c65743-b8f8-4651-b3c3-6effbf3cfaba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98f385e0f5924e5ab83bbc0be3c7ad00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:49:06Z,use_quota=True,user_id='1d13f09c33a848e180c34f95d44622ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Creating volume f9c65743-b8f8-4651-b3c3-6effbf3cfaba {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:49:06 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f9c65743-b8f8-4651-b3c3-6effbf3cfaba 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:06 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=121, name=volume-f9c65743-b8f8-4651-b3c3-6effbf3cfaba, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c3e4f889-eae6-4091-9c1b-93a40fbf4f51 tempest-CreateVolumesFromImageTest-1289425725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c3e4f889-eae6-4091-9c1b-93a40fbf4f51 tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c3e4f889-eae6-4091-9c1b-93a40fbf4f51 tempest-CreateVolumesFromImageTest-1289425725 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-c3e4f889-eae6-4091-9c1b-93a40fbf4f51 tempest-CreateVolumesFromImageTest-1289425725 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-c3e4f889-eae6-4091-9c1b-93a40fbf4f51 tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c3e4f889-eae6-4091-9c1b-93a40fbf4f51 tempest-CreateVolumesFromImageTest-1289425725 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f9c65743-b8f8-4651-b3c3-6effbf3cfaba 1073741824" returned: 0 in 0.581s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f9c65743-b8f8-4651-b3c3-6effbf3cfaba {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c3e4f889-eae6-4091-9c1b-93a40fbf4f51 tempest-CreateVolumesFromImageTest-1289425725 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.221s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-c3e4f889-eae6-4091-9c1b-93a40fbf4f51 tempest-CreateVolumesFromImageTest-1289425725 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:49:06 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-c3e4f889-eae6-4091-9c1b-93a40fbf4f51 tempest-CreateVolumesFromImageTest-1289425725 None] Deleted volume successfully. Sep 10 15:49:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f9c65743-b8f8-4651-b3c3-6effbf3cfaba" returned: 0 in 0.301s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:07 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] <== create_volume: return (958ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:49:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:49:07 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c3e4f889-eae6-4091-9c1b-93a40fbf4f51 tempest-CreateVolumesFromImageTest-1289425725 None] Lock "cinder-7cfb7ffa-8d61-4e66-ad38-28ae9071bbae-delete_volume" released by "delete_volume" :: held 3.299s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:49:07 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdeb91dd-9795-4bbf-bc5b-2b4bdfa4eac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9c65743-b8f8-4651-b3c3-6effbf3cfaba', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:07 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42a19a6c-42ac-4238-83ca-d5c9c1a0927d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:07 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-2f221646-214f-48d7-870d-976b9fb7cb8b tempest-CreateVolumesFromImageTest-1289425725 None] Acquiring lock "cinder-805812c2-597b-48d9-be3d-641e7dc26659-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:49:07 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Volume volume-f9c65743-b8f8-4651-b3c3-6effbf3cfaba (f9c65743-b8f8-4651-b3c3-6effbf3cfaba): created successfully Sep 10 15:49:07 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42a19a6c-42ac-4238-83ca-d5c9c1a0927d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:07 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Flow 'volume_create_manager' (6fa79588-1f4f-4919-817f-658fb541da3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:49:07 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-2f221646-214f-48d7-870d-976b9fb7cb8b tempest-CreateVolumesFromImageTest-1289425725 None] Lock "cinder-805812c2-597b-48d9-be3d-641e7dc26659-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:49:07 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-fb3cc225-80de-4e31-a2ac-8a265658c039 tempest-VolumesTransfersV355Test-2038652961 None] Created volume successfully. Sep 10 15:49:07 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-2f221646-214f-48d7-870d-976b9fb7cb8b tempest-CreateVolumesFromImageTest-1289425725 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:49:07 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-2f221646-214f-48d7-870d-976b9fb7cb8b tempest-CreateVolumesFromImageTest-1289425725 None] Acquiring lock "cinder-quobyte-805812c2-597b-48d9-be3d-641e7dc26659" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:49:07 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-2f221646-214f-48d7-870d-976b9fb7cb8b tempest-CreateVolumesFromImageTest-1289425725 None] Lock "cinder-quobyte-805812c2-597b-48d9-be3d-641e7dc26659" acquired by "delete_volume" :: waited 0.029s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:49:07 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d4ee46-7ef2-4c9a-bac5-71679c4e7f2c]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:49:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2f221646-214f-48d7-870d-976b9fb7cb8b tempest-CreateVolumesFromImageTest-1289425725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-805812c2-597b-48d9-be3d-641e7dc26659 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2f221646-214f-48d7-870d-976b9fb7cb8b tempest-CreateVolumesFromImageTest-1289425725 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-805812c2-597b-48d9-be3d-641e7dc26659" returned: 0 in 0.671s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2f221646-214f-48d7-870d-976b9fb7cb8b tempest-CreateVolumesFromImageTest-1289425725 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-805812c2-597b-48d9-be3d-641e7dc26659 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2f221646-214f-48d7-870d-976b9fb7cb8b tempest-CreateVolumesFromImageTest-1289425725 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-805812c2-597b-48d9-be3d-641e7dc26659" returned: 0 in 0.179s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:08 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e24d2c30-cca8-4494-b447-530f22918b3a tempest-VolumesTransfersV355Test-1365388337 None] Acquiring lock "cinder-f9c65743-b8f8-4651-b3c3-6effbf3cfaba-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:49:08 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-2f221646-214f-48d7-870d-976b9fb7cb8b tempest-CreateVolumesFromImageTest-1289425725 None] Lock "cinder-quobyte-805812c2-597b-48d9-be3d-641e7dc26659" released by "delete_volume" :: held 1.301s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:49:09 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e24d2c30-cca8-4494-b447-530f22918b3a tempest-VolumesTransfersV355Test-1365388337 None] Lock "cinder-f9c65743-b8f8-4651-b3c3-6effbf3cfaba-delete_volume" acquired by "delete_volume" :: waited 0.290s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:49:09 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-e24d2c30-cca8-4494-b447-530f22918b3a tempest-VolumesTransfersV355Test-1365388337 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:49:09 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e24d2c30-cca8-4494-b447-530f22918b3a tempest-VolumesTransfersV355Test-1365388337 None] Acquiring lock "cinder-quobyte-f9c65743-b8f8-4651-b3c3-6effbf3cfaba" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:49:09 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e24d2c30-cca8-4494-b447-530f22918b3a tempest-VolumesTransfersV355Test-1365388337 None] Lock "cinder-quobyte-f9c65743-b8f8-4651-b3c3-6effbf3cfaba" acquired by "delete_volume" :: waited 0.034s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:49:09 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[13793724-eb8b-4f79-92bc-56ac301c6ff9]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:49:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e24d2c30-cca8-4494-b447-530f22918b3a tempest-VolumesTransfersV355Test-1365388337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f9c65743-b8f8-4651-b3c3-6effbf3cfaba {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:09 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-2f221646-214f-48d7-870d-976b9fb7cb8b tempest-CreateVolumesFromImageTest-1289425725 None] Created reservations ['1af9925d-0bd0-4561-9dae-6b0398f07715', '334d178e-ae8e-4dcf-a1b3-4a6d5c8a6d5f', 'd9047941-c7cd-44f2-a9ad-c6fc2bb7e376', 'dc9a8150-b472-4535-b4b9-666724622e78'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:49:10 devstack quobyte-client[82814]: System call of process 97269 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:49:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2f221646-214f-48d7-870d-976b9fb7cb8b tempest-CreateVolumesFromImageTest-1289425725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:49:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2f221646-214f-48d7-870d-976b9fb7cb8b tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:49:10 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2f221646-214f-48d7-870d-976b9fb7cb8b tempest-CreateVolumesFromImageTest-1289425725 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:49:10 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2f221646-214f-48d7-870d-976b9fb7cb8b tempest-CreateVolumesFromImageTest-1289425725 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:49:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2f221646-214f-48d7-870d-976b9fb7cb8b tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:49:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2f221646-214f-48d7-870d-976b9fb7cb8b tempest-CreateVolumesFromImageTest-1289425725 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e24d2c30-cca8-4494-b447-530f22918b3a tempest-VolumesTransfersV355Test-1365388337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f9c65743-b8f8-4651-b3c3-6effbf3cfaba" returned: 0 in 0.963s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e24d2c30-cca8-4494-b447-530f22918b3a tempest-VolumesTransfersV355Test-1365388337 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f9c65743-b8f8-4651-b3c3-6effbf3cfaba {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2f221646-214f-48d7-870d-976b9fb7cb8b tempest-CreateVolumesFromImageTest-1289425725 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.256s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:10 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-2f221646-214f-48d7-870d-976b9fb7cb8b tempest-CreateVolumesFromImageTest-1289425725 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:49:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e24d2c30-cca8-4494-b447-530f22918b3a tempest-VolumesTransfersV355Test-1365388337 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f9c65743-b8f8-4651-b3c3-6effbf3cfaba" returned: 0 in 0.237s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:10 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-2f221646-214f-48d7-870d-976b9fb7cb8b tempest-CreateVolumesFromImageTest-1289425725 None] Deleted volume successfully. Sep 10 15:49:10 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e24d2c30-cca8-4494-b447-530f22918b3a tempest-VolumesTransfersV355Test-1365388337 None] Lock "cinder-quobyte-f9c65743-b8f8-4651-b3c3-6effbf3cfaba" released by "delete_volume" :: held 1.591s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:49:11 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a875bcb5-97fd-4f98-bfbc-e7cbe80aa25f tempest-CreateVolumesFromImageTest-1289425725 None] Acquiring lock "cinder-2b3b03ce-40d0-409e-87aa-51e49753e9d0-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:49:11 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-2f221646-214f-48d7-870d-976b9fb7cb8b tempest-CreateVolumesFromImageTest-1289425725 None] Lock "cinder-805812c2-597b-48d9-be3d-641e7dc26659-delete_volume" released by "delete_volume" :: held 3.714s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:49:11 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a875bcb5-97fd-4f98-bfbc-e7cbe80aa25f tempest-CreateVolumesFromImageTest-1289425725 None] Lock "cinder-2b3b03ce-40d0-409e-87aa-51e49753e9d0-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:49:11 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-a875bcb5-97fd-4f98-bfbc-e7cbe80aa25f tempest-CreateVolumesFromImageTest-1289425725 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:49:11 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a875bcb5-97fd-4f98-bfbc-e7cbe80aa25f tempest-CreateVolumesFromImageTest-1289425725 None] Acquiring lock "cinder-quobyte-2b3b03ce-40d0-409e-87aa-51e49753e9d0" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:49:11 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a875bcb5-97fd-4f98-bfbc-e7cbe80aa25f tempest-CreateVolumesFromImageTest-1289425725 None] Lock "cinder-quobyte-2b3b03ce-40d0-409e-87aa-51e49753e9d0" acquired by "delete_volume" :: waited 0.026s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:49:11 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ad3686-9d4b-493c-951d-5c1c58cb3de0]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:49:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a875bcb5-97fd-4f98-bfbc-e7cbe80aa25f tempest-CreateVolumesFromImageTest-1289425725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b3b03ce-40d0-409e-87aa-51e49753e9d0 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:11 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-e24d2c30-cca8-4494-b447-530f22918b3a tempest-VolumesTransfersV355Test-1365388337 None] Created reservations ['2d773c4a-580b-4a51-85c6-ffe753a7dc6f', 'ca2ae07e-bd98-444f-898b-dc0eb3632e55', '507464fb-475a-40c5-85f7-09157cd25035', 'b8afdd28-d512-4944-b3d2-7ae879bfe206'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:49:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e24d2c30-cca8-4494-b447-530f22918b3a tempest-VolumesTransfersV355Test-1365388337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:49:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e24d2c30-cca8-4494-b447-530f22918b3a tempest-VolumesTransfersV355Test-1365388337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:49:11 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e24d2c30-cca8-4494-b447-530f22918b3a tempest-VolumesTransfersV355Test-1365388337 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:49:12 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e24d2c30-cca8-4494-b447-530f22918b3a tempest-VolumesTransfersV355Test-1365388337 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:49:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e24d2c30-cca8-4494-b447-530f22918b3a tempest-VolumesTransfersV355Test-1365388337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:49:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e24d2c30-cca8-4494-b447-530f22918b3a tempest-VolumesTransfersV355Test-1365388337 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a875bcb5-97fd-4f98-bfbc-e7cbe80aa25f tempest-CreateVolumesFromImageTest-1289425725 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b3b03ce-40d0-409e-87aa-51e49753e9d0" returned: 0 in 0.789s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a875bcb5-97fd-4f98-bfbc-e7cbe80aa25f tempest-CreateVolumesFromImageTest-1289425725 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b3b03ce-40d0-409e-87aa-51e49753e9d0 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e24d2c30-cca8-4494-b447-530f22918b3a tempest-VolumesTransfersV355Test-1365388337 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.426s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:12 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-e24d2c30-cca8-4494-b447-530f22918b3a tempest-VolumesTransfersV355Test-1365388337 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:49:12 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-e24d2c30-cca8-4494-b447-530f22918b3a tempest-VolumesTransfersV355Test-1365388337 None] Deleted volume successfully. Sep 10 15:49:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a875bcb5-97fd-4f98-bfbc-e7cbe80aa25f tempest-CreateVolumesFromImageTest-1289425725 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-2b3b03ce-40d0-409e-87aa-51e49753e9d0" returned: 0 in 0.558s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:12 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a875bcb5-97fd-4f98-bfbc-e7cbe80aa25f tempest-CreateVolumesFromImageTest-1289425725 None] Lock "cinder-quobyte-2b3b03ce-40d0-409e-87aa-51e49753e9d0" released by "delete_volume" :: held 1.560s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:49:12 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e24d2c30-cca8-4494-b447-530f22918b3a tempest-VolumesTransfersV355Test-1365388337 None] Lock "cinder-f9c65743-b8f8-4651-b3c3-6effbf3cfaba-delete_volume" released by "delete_volume" :: held 3.859s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:49:13 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-a875bcb5-97fd-4f98-bfbc-e7cbe80aa25f tempest-CreateVolumesFromImageTest-1289425725 None] Created reservations ['131ba086-2935-44ca-ac34-53f84a18cb09', '060f3baa-459f-4736-a5ef-3e471ed1894e', '7a2f20f0-ff49-4e1e-91e1-af06d48f773e', '302893f5-e2ba-42dc-aad2-4a6fcece05a1'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:49:13 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a875bcb5-97fd-4f98-bfbc-e7cbe80aa25f tempest-CreateVolumesFromImageTest-1289425725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:49:13 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a875bcb5-97fd-4f98-bfbc-e7cbe80aa25f tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:49:13 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a875bcb5-97fd-4f98-bfbc-e7cbe80aa25f tempest-CreateVolumesFromImageTest-1289425725 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:49:13 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a875bcb5-97fd-4f98-bfbc-e7cbe80aa25f tempest-CreateVolumesFromImageTest-1289425725 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:49:13 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a875bcb5-97fd-4f98-bfbc-e7cbe80aa25f tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:49:13 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a875bcb5-97fd-4f98-bfbc-e7cbe80aa25f tempest-CreateVolumesFromImageTest-1289425725 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:13 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a875bcb5-97fd-4f98-bfbc-e7cbe80aa25f tempest-CreateVolumesFromImageTest-1289425725 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.152s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:13 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-a875bcb5-97fd-4f98-bfbc-e7cbe80aa25f tempest-CreateVolumesFromImageTest-1289425725 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:49:13 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-a875bcb5-97fd-4f98-bfbc-e7cbe80aa25f tempest-CreateVolumesFromImageTest-1289425725 None] Deleted volume successfully. Sep 10 15:49:13 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d56fb6b0-c29d-44f9-8f31-722077fc620b tempest-CreateVolumesFromImageTest-1289425725 None] Acquiring lock "cinder-3e3cd17f-a603-44a5-957a-3cf4e9d38df5-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:49:14 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a875bcb5-97fd-4f98-bfbc-e7cbe80aa25f tempest-CreateVolumesFromImageTest-1289425725 None] Lock "cinder-2b3b03ce-40d0-409e-87aa-51e49753e9d0-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:49:14 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d56fb6b0-c29d-44f9-8f31-722077fc620b tempest-CreateVolumesFromImageTest-1289425725 None] Lock "cinder-3e3cd17f-a603-44a5-957a-3cf4e9d38df5-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:49:14 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-d56fb6b0-c29d-44f9-8f31-722077fc620b tempest-CreateVolumesFromImageTest-1289425725 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:49:14 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d56fb6b0-c29d-44f9-8f31-722077fc620b tempest-CreateVolumesFromImageTest-1289425725 None] Acquiring lock "cinder-quobyte-3e3cd17f-a603-44a5-957a-3cf4e9d38df5" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:49:14 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d56fb6b0-c29d-44f9-8f31-722077fc620b tempest-CreateVolumesFromImageTest-1289425725 None] Lock "cinder-quobyte-3e3cd17f-a603-44a5-957a-3cf4e9d38df5" acquired by "delete_volume" :: waited 0.018s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:49:14 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[781fea31-bfc1-464b-b65e-0475e9ad7f90]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:49:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d56fb6b0-c29d-44f9-8f31-722077fc620b tempest-CreateVolumesFromImageTest-1289425725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3e3cd17f-a603-44a5-957a-3cf4e9d38df5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:14 devstack quobyte-client[82814]: System call of process 97287 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:49:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d56fb6b0-c29d-44f9-8f31-722077fc620b tempest-CreateVolumesFromImageTest-1289425725 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3e3cd17f-a603-44a5-957a-3cf4e9d38df5" returned: 0 in 0.557s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d56fb6b0-c29d-44f9-8f31-722077fc620b tempest-CreateVolumesFromImageTest-1289425725 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3e3cd17f-a603-44a5-957a-3cf4e9d38df5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d56fb6b0-c29d-44f9-8f31-722077fc620b tempest-CreateVolumesFromImageTest-1289425725 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-3e3cd17f-a603-44a5-957a-3cf4e9d38df5" returned: 0 in 0.127s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:15 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d56fb6b0-c29d-44f9-8f31-722077fc620b tempest-CreateVolumesFromImageTest-1289425725 None] Lock "cinder-quobyte-3e3cd17f-a603-44a5-957a-3cf4e9d38df5" released by "delete_volume" :: held 1.087s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:49:15 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-d56fb6b0-c29d-44f9-8f31-722077fc620b tempest-CreateVolumesFromImageTest-1289425725 None] Created reservations ['0f7f3cef-b241-432c-9b3d-db02c39265a2', '4199ff03-aaa7-45c3-ad0b-094c39afb799', '407816b7-4f71-4b82-9a70-42b175ae4c79', '1571cfca-410b-448f-bdcf-ca53ee735fb1'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:49:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d56fb6b0-c29d-44f9-8f31-722077fc620b tempest-CreateVolumesFromImageTest-1289425725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:49:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d56fb6b0-c29d-44f9-8f31-722077fc620b tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:49:16 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d56fb6b0-c29d-44f9-8f31-722077fc620b tempest-CreateVolumesFromImageTest-1289425725 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:49:16 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d56fb6b0-c29d-44f9-8f31-722077fc620b tempest-CreateVolumesFromImageTest-1289425725 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:49:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d56fb6b0-c29d-44f9-8f31-722077fc620b tempest-CreateVolumesFromImageTest-1289425725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:49:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d56fb6b0-c29d-44f9-8f31-722077fc620b tempest-CreateVolumesFromImageTest-1289425725 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d56fb6b0-c29d-44f9-8f31-722077fc620b tempest-CreateVolumesFromImageTest-1289425725 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.303s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:16 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-d56fb6b0-c29d-44f9-8f31-722077fc620b tempest-CreateVolumesFromImageTest-1289425725 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:49:16 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-d56fb6b0-c29d-44f9-8f31-722077fc620b tempest-CreateVolumesFromImageTest-1289425725 None] Deleted volume successfully. Sep 10 15:49:16 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d56fb6b0-c29d-44f9-8f31-722077fc620b tempest-CreateVolumesFromImageTest-1289425725 None] Lock "cinder-3e3cd17f-a603-44a5-957a-3cf4e9d38df5-delete_volume" released by "delete_volume" :: held 2.955s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:49:21 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:49:21 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:49:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Flow 'volume_create_manager' (6e6f71e4-45e1-4086-aa18-a934b2a1c483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:49:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f40c5c-2fb0-48f7-8f6e-301bd92b1823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f40c5c-2fb0-48f7-8f6e-301bd92b1823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfc219a8-827e-4752-8215-2dcfdcfe45aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022a8db53649463596f6b79dc9cdd7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:49:22Z,use_quota=True,user_id='c2af8a22bdf044ec8d8b20c5c2b96690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d153356c-ab4b-4307-848b-53d9a446d4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d153356c-ab4b-4307-848b-53d9a446d4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248039fa-6f92-499c-a4e9-9e64d059ab35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248039fa-6f92-499c-a4e9-9e64d059ab35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfc219a8-827e-4752-8215-2dcfdcfe45aa', 'volume_name': 'volume-bfc219a8-827e-4752-8215-2dcfdcfe45aa', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138f997d-3f12-4cc9-b7d3-3018496612b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138f997d-3f12-4cc9-b7d3-3018496612b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ea4e6e-fe2a-472a-9bdf-ca44c320665b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:22 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Volume bfc219a8-827e-4752-8215-2dcfdcfe45aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfc219a8-827e-4752-8215-2dcfdcfe45aa', 'volume_size': 1} Sep 10 15:49:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:49:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:49:22 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfc219a8-827e-4752-8215-2dcfdcfe45aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022a8db53649463596f6b79dc9cdd7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:49:22Z,use_quota=True,user_id='c2af8a22bdf044ec8d8b20c5c2b96690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:49:22 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Creating volume bfc219a8-827e-4752-8215-2dcfdcfe45aa {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:49:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:49:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:49:22 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:49:22 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:49:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:49:22 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:49:22 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:49:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bfc219a8-827e-4752-8215-2dcfdcfe45aa 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:22 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=122, name=volume-bfc219a8-827e-4752-8215-2dcfdcfe45aa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:49:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bfc219a8-827e-4752-8215-2dcfdcfe45aa 1073741824" returned: 0 in 0.536s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bfc219a8-827e-4752-8215-2dcfdcfe45aa {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bfc219a8-827e-4752-8215-2dcfdcfe45aa" returned: 0 in 0.097s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:22 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] <== create_volume: return (712ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:49:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:49:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ea4e6e-fe2a-472a-9bdf-ca44c320665b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfc219a8-827e-4752-8215-2dcfdcfe45aa', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd1b07cc-4014-4a30-b19d-62a561731a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:23 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Volume volume-bfc219a8-827e-4752-8215-2dcfdcfe45aa (bfc219a8-827e-4752-8215-2dcfdcfe45aa): created successfully Sep 10 15:49:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd1b07cc-4014-4a30-b19d-62a561731a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Flow 'volume_create_manager' (6e6f71e4-45e1-4086-aa18-a934b2a1c483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:49:23 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-8f2f5c7f-1cf7-49b7-95f6-b52dde8abde7 tempest-CinderUnicodeTest-146879644 None] Created volume successfully. Sep 10 15:49:25 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=62,cinder:INSERT=22,cinder:UPDATE=121,cinder:DELETE=12 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:49:25 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:49:25 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:49:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Flow 'volume_create_manager' (0bcf84d3-2737-49a2-851f-3b22c1760e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:49:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1967154-8a4f-470e-9cca-80b917ca6cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1967154-8a4f-470e-9cca-80b917ca6cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:49:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1961138178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86feedc6-4a8b-431c-97e4-0e08ebfb786e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022a8db53649463596f6b79dc9cdd7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:49:25Z,use_quota=True,user_id='c2af8a22bdf044ec8d8b20c5c2b96690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0c2e9a-b762-4866-a98a-8252549d43ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0c2e9a-b762-4866-a98a-8252549d43ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b279d45a-0f94-421f-b226-887d07b6cae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b279d45a-0f94-421f-b226-887d07b6cae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86feedc6-4a8b-431c-97e4-0e08ebfb786e', 'volume_name': 'volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67b0b04e-90f1-47f5-b091-3345f0a20341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67b0b04e-90f1-47f5-b091-3345f0a20341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a2926c-4e8a-44da-8ba8-0a669a8a9fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:25 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Volume 86feedc6-4a8b-431c-97e4-0e08ebfb786e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e', 'volume_size': 1} Sep 10 15:49:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:49:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:49:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:49:24Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1961138178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86feedc6-4a8b-431c-97e4-0e08ebfb786e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022a8db53649463596f6b79dc9cdd7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:49:25Z,use_quota=True,user_id='c2af8a22bdf044ec8d8b20c5c2b96690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:49:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Creating volume 86feedc6-4a8b-431c-97e4-0e08ebfb786e {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:49:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:49:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:49:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:49:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:49:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:49:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:49:25 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:49:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:25 devstack quobyte-client[82814]: System call of process 97299 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:49:25 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=123, name=volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:49:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e 1073741824" returned: 0 in 0.532s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e" returned: 0 in 0.152s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] <== create_volume: return (757ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a2926c-4e8a-44da-8ba8-0a669a8a9fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed006dd-6744-48b9-93f8-5f9fd62f2ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:26 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Volume volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e (86feedc6-4a8b-431c-97e4-0e08ebfb786e): created successfully Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed006dd-6744-48b9-93f8-5f9fd62f2ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Flow 'volume_create_manager' (0bcf84d3-2737-49a2-851f-3b22c1760e7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:49:26 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-7c6cf522-f381-4e76-8c38-bb1ccc6d63bc tempest-CinderUnicodeTest-146879644 None] Created volume successfully. Sep 10 15:49:26 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Flow 'volume_create_manager' (1cb2c89a-7290-4b3d-81df-3872022760a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d64bc50a-6947-4779-acf9-bba247087729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d64bc50a-6947-4779-acf9-bba247087729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-376828983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c882a520-fd79-4d69-816f-59ecd86506f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1536c3a7f4e5458089568c5bc6729f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:49:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:49:26Z,use_quota=True,user_id='f8596ef6ea5147899668a89ddbde6abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9d8553-ff11-4185-8edf-2b5d2cf3fdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b9d8553-ff11-4185-8edf-2b5d2cf3fdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34966550-c423-415f-a96e-86528b02851c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34966550-c423-415f-a96e-86528b02851c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c882a520-fd79-4d69-816f-59ecd86506f2', 'volume_name': 'volume-c882a520-fd79-4d69-816f-59ecd86506f2', 'volume_size': 2}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f4a63f-aef3-45e8-bebe-7209e42c56b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2f4a63f-aef3-45e8-bebe-7209e42c56b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015cfd51-b946-4d2e-91c0-c670b507e656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:26 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Volume c882a520-fd79-4d69-816f-59ecd86506f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c882a520-fd79-4d69-816f-59ecd86506f2', 'volume_size': 2} Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-376828983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c882a520-fd79-4d69-816f-59ecd86506f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1536c3a7f4e5458089568c5bc6729f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:49:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:49:26Z,use_quota=True,user_id='f8596ef6ea5147899668a89ddbde6abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Creating volume c882a520-fd79-4d69-816f-59ecd86506f2 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:49:26 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:49:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c882a520-fd79-4d69-816f-59ecd86506f2 2147483648 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:26 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=124, name=volume-c882a520-fd79-4d69-816f-59ecd86506f2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:49:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c882a520-fd79-4d69-816f-59ecd86506f2 2147483648" returned: 0 in 0.468s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c882a520-fd79-4d69-816f-59ecd86506f2 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c882a520-fd79-4d69-816f-59ecd86506f2" returned: 0 in 0.118s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:27 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] <== create_volume: return (650ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:49:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.662s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:49:27 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (015cfd51-b946-4d2e-91c0-c670b507e656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c882a520-fd79-4d69-816f-59ecd86506f2', 'volume_size': 2}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:27 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d21d125-01db-4051-912a-814c38287633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:27 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Volume volume-c882a520-fd79-4d69-816f-59ecd86506f2 (c882a520-fd79-4d69-816f-59ecd86506f2): created successfully Sep 10 15:49:27 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d21d125-01db-4051-912a-814c38287633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:27 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Flow 'volume_create_manager' (1cb2c89a-7290-4b3d-81df-3872022760a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:49:27 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-1b9b7f0c-bbf2-4570-8c9d-db3433f36b69 tempest-VolumesCloneNegativeTest-1649093271 None] Created volume successfully. Sep 10 15:49:27 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-d8531156-3d44-468a-9250-3b8251f2b98c tempest-CinderUnicodeTest-146879644 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:49:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d8531156-3d44-468a-9250-3b8251f2b98c tempest-CinderUnicodeTest-146879644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:49:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d8531156-3d44-468a-9250-3b8251f2b98c tempest-CinderUnicodeTest-146879644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:49:27 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-d8531156-3d44-468a-9250-3b8251f2b98c tempest-CinderUnicodeTest-146879644 None] Creating offline snapshot 6e700fe2-1d67-4700-a460-05bad2f8ed10 of volume 86feedc6-4a8b-431c-97e4-0e08ebfb786e {{(pid=82800) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 15:49:27 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa24e723-c320-4d89-b272-03dbe4aa0018]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:49:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8531156-3d44-468a-9250-3b8251f2b98c tempest-CinderUnicodeTest-146879644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8531156-3d44-468a-9250-3b8251f2b98c tempest-CinderUnicodeTest-146879644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e" returned: 0 in 0.415s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8531156-3d44-468a-9250-3b8251f2b98c tempest-CinderUnicodeTest-146879644 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e.6e700fe2-1d67-4700-a460-05bad2f8ed10 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:28 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=125, name=volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e.6e700fe2-1d67-4700-a460-05bad2f8ed10, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:49:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8531156-3d44-468a-9250-3b8251f2b98c tempest-CinderUnicodeTest-146879644 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e.6e700fe2-1d67-4700-a460-05bad2f8ed10 1G" returned: 0 in 0.284s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8531156-3d44-468a-9250-3b8251f2b98c tempest-CinderUnicodeTest-146879644 None] Running cmd (subprocess): qemu-img rebase -u -b volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e.6e700fe2-1d67-4700-a460-05bad2f8ed10 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:28 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a44ea676-787c-412c-a5c7-b97f54d5e2c5 tempest-VolumesCloneNegativeTest-1649093271 None] Acquiring lock "cinder-c882a520-fd79-4d69-816f-59ecd86506f2-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:49:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8531156-3d44-468a-9250-3b8251f2b98c tempest-CinderUnicodeTest-146879644 None] CMD "qemu-img rebase -u -b volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e.6e700fe2-1d67-4700-a460-05bad2f8ed10" returned: 0 in 0.353s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-d8531156-3d44-468a-9250-3b8251f2b98c tempest-CinderUnicodeTest-146879644 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e.6e700fe2-1d67-4700-a460-05bad2f8ed10 is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:49:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8531156-3d44-468a-9250-3b8251f2b98c tempest-CinderUnicodeTest-146879644 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e.6e700fe2-1d67-4700-a460-05bad2f8ed10 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8531156-3d44-468a-9250-3b8251f2b98c tempest-CinderUnicodeTest-146879644 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e.6e700fe2-1d67-4700-a460-05bad2f8ed10" returned: 0 in 0.175s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-d8531156-3d44-468a-9250-3b8251f2b98c tempest-CinderUnicodeTest-146879644 None] Setting permissions: /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e -> 1000:1000 {{(pid=82800) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 15:49:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8531156-3d44-468a-9250-3b8251f2b98c tempest-CinderUnicodeTest-146879644 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e.6e700fe2-1d67-4700-a460-05bad2f8ed10 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:29 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a44ea676-787c-412c-a5c7-b97f54d5e2c5 tempest-VolumesCloneNegativeTest-1649093271 None] Lock "cinder-c882a520-fd79-4d69-816f-59ecd86506f2-delete_volume" acquired by "delete_volume" :: waited 0.378s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:49:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8531156-3d44-468a-9250-3b8251f2b98c tempest-CinderUnicodeTest-146879644 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e.6e700fe2-1d67-4700-a460-05bad2f8ed10" returned: 0 in 0.299s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8531156-3d44-468a-9250-3b8251f2b98c tempest-CinderUnicodeTest-146879644 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:49:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:49:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:49:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:49:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:49:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:49:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:30 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-a44ea676-787c-412c-a5c7-b97f54d5e2c5 tempest-VolumesCloneNegativeTest-1649093271 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:49:30 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a44ea676-787c-412c-a5c7-b97f54d5e2c5 tempest-VolumesCloneNegativeTest-1649093271 None] Acquiring lock "cinder-quobyte-c882a520-fd79-4d69-816f-59ecd86506f2" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:49:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8531156-3d44-468a-9250-3b8251f2b98c tempest-CinderUnicodeTest-146879644 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e.info" returned: 0 in 0.667s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-d8531156-3d44-468a-9250-3b8251f2b98c tempest-CinderUnicodeTest-146879644 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e.info is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:49:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8531156-3d44-468a-9250-3b8251f2b98c tempest-CinderUnicodeTest-146879644 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.443s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:30 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:49:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d8531156-3d44-468a-9250-3b8251f2b98c tempest-CinderUnicodeTest-146879644 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e.info" returned: 0 in 0.219s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:30 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a44ea676-787c-412c-a5c7-b97f54d5e2c5 tempest-VolumesCloneNegativeTest-1649093271 None] Lock "cinder-quobyte-c882a520-fd79-4d69-816f-59ecd86506f2" acquired by "delete_volume" :: waited 0.282s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:49:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d8531156-3d44-468a-9250-3b8251f2b98c tempest-CinderUnicodeTest-146879644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.674s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:49:30 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd77e16-6b27-4212-8074-04b8ea82c008]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:49:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a44ea676-787c-412c-a5c7-b97f54d5e2c5 tempest-VolumesCloneNegativeTest-1649093271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c882a520-fd79-4d69-816f-59ecd86506f2 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:30 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-d8531156-3d44-468a-9250-3b8251f2b98c tempest-CinderUnicodeTest-146879644 None] Create snapshot completed successfully Sep 10 15:49:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a44ea676-787c-412c-a5c7-b97f54d5e2c5 tempest-VolumesCloneNegativeTest-1649093271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c882a520-fd79-4d69-816f-59ecd86506f2" returned: 0 in 0.569s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a44ea676-787c-412c-a5c7-b97f54d5e2c5 tempest-VolumesCloneNegativeTest-1649093271 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c882a520-fd79-4d69-816f-59ecd86506f2 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a44ea676-787c-412c-a5c7-b97f54d5e2c5 tempest-VolumesCloneNegativeTest-1649093271 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-c882a520-fd79-4d69-816f-59ecd86506f2" returned: 0 in 0.088s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:31 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a44ea676-787c-412c-a5c7-b97f54d5e2c5 tempest-VolumesCloneNegativeTest-1649093271 None] Lock "cinder-quobyte-c882a520-fd79-4d69-816f-59ecd86506f2" released by "delete_volume" :: held 0.899s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:49:31 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-a44ea676-787c-412c-a5c7-b97f54d5e2c5 tempest-VolumesCloneNegativeTest-1649093271 None] Created reservations ['352094e0-fbad-4c19-8bfe-90dd03c62265', '80674b68-3e9d-4ae6-bb73-489c6e32c550', 'a3a9e081-41be-415f-bc7e-661958ea205d', '21a29fa5-1cb3-4293-b5e8-98e7797beb24'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:49:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a44ea676-787c-412c-a5c7-b97f54d5e2c5 tempest-VolumesCloneNegativeTest-1649093271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:49:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a44ea676-787c-412c-a5c7-b97f54d5e2c5 tempest-VolumesCloneNegativeTest-1649093271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:49:31 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a44ea676-787c-412c-a5c7-b97f54d5e2c5 tempest-VolumesCloneNegativeTest-1649093271 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:49:31 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a44ea676-787c-412c-a5c7-b97f54d5e2c5 tempest-VolumesCloneNegativeTest-1649093271 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:49:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a44ea676-787c-412c-a5c7-b97f54d5e2c5 tempest-VolumesCloneNegativeTest-1649093271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:49:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a44ea676-787c-412c-a5c7-b97f54d5e2c5 tempest-VolumesCloneNegativeTest-1649093271 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:32 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a46ccad6-cc9c-4d7c-aa4c-0685f85a4f71 tempest-CinderUnicodeTest-146879644 None] Acquiring lock "cinder-6e700fe2-1d67-4700-a460-05bad2f8ed10-delete_snapshot" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:49:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a44ea676-787c-412c-a5c7-b97f54d5e2c5 tempest-VolumesCloneNegativeTest-1649093271 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.341s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:32 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-a44ea676-787c-412c-a5c7-b97f54d5e2c5 tempest-VolumesCloneNegativeTest-1649093271 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:49:32 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-a44ea676-787c-412c-a5c7-b97f54d5e2c5 tempest-VolumesCloneNegativeTest-1649093271 None] Deleted volume successfully. Sep 10 15:49:32 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a46ccad6-cc9c-4d7c-aa4c-0685f85a4f71 tempest-CinderUnicodeTest-146879644 None] Lock "cinder-6e700fe2-1d67-4700-a460-05bad2f8ed10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.315s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:49:32 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-a46ccad6-cc9c-4d7c-aa4c-0685f85a4f71 tempest-CinderUnicodeTest-146879644 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:49:32 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a46ccad6-cc9c-4d7c-aa4c-0685f85a4f71 tempest-CinderUnicodeTest-146879644 None] Acquiring lock "cinder-quobyte-86feedc6-4a8b-431c-97e4-0e08ebfb786e" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:49:32 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a44ea676-787c-412c-a5c7-b97f54d5e2c5 tempest-VolumesCloneNegativeTest-1649093271 None] Lock "cinder-c882a520-fd79-4d69-816f-59ecd86506f2-delete_volume" released by "delete_volume" :: held 3.212s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:49:32 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a46ccad6-cc9c-4d7c-aa4c-0685f85a4f71 tempest-CinderUnicodeTest-146879644 None] Lock "cinder-quobyte-86feedc6-4a8b-431c-97e4-0e08ebfb786e" acquired by "delete_snapshot" :: waited 0.042s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:49:32 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a46ccad6-cc9c-4d7c-aa4c-0685f85a4f71 tempest-CinderUnicodeTest-146879644 None] Acquiring lock "cinder-quobyte-6e700fe2-1d67-4700-a460-05bad2f8ed10" by "_delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:49:32 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a46ccad6-cc9c-4d7c-aa4c-0685f85a4f71 tempest-CinderUnicodeTest-146879644 None] Lock "cinder-quobyte-6e700fe2-1d67-4700-a460-05bad2f8ed10" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:49:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-a46ccad6-cc9c-4d7c-aa4c-0685f85a4f71 tempest-CinderUnicodeTest-146879644 None] Deleting offline snapshot 6e700fe2-1d67-4700-a460-05bad2f8ed10 of volume 86feedc6-4a8b-431c-97e4-0e08ebfb786e {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 15:49:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-a46ccad6-cc9c-4d7c-aa4c-0685f85a4f71 tempest-CinderUnicodeTest-146879644 None] snapshot_file for this snap is: volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e.6e700fe2-1d67-4700-a460-05bad2f8ed10 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 15:49:32 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eaac333-f1b2-4640-9ecd-f961f5122b6b]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:49:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a46ccad6-cc9c-4d7c-aa4c-0685f85a4f71 tempest-CinderUnicodeTest-146879644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e.6e700fe2-1d67-4700-a460-05bad2f8ed10 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a46ccad6-cc9c-4d7c-aa4c-0685f85a4f71 tempest-CinderUnicodeTest-146879644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e.6e700fe2-1d67-4700-a460-05bad2f8ed10" returned: 0 in 0.460s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:33 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-a46ccad6-cc9c-4d7c-aa4c-0685f85a4f71 tempest-CinderUnicodeTest-146879644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:49:33 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca03b41f-186e-4513-a73e-1a603367296f]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:49:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a46ccad6-cc9c-4d7c-aa4c-0685f85a4f71 tempest-CinderUnicodeTest-146879644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a46ccad6-cc9c-4d7c-aa4c-0685f85a4f71 tempest-CinderUnicodeTest-146879644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e" returned: 0 in 0.429s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a46ccad6-cc9c-4d7c-aa4c-0685f85a4f71 tempest-CinderUnicodeTest-146879644 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e.6e700fe2-1d67-4700-a460-05bad2f8ed10 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:33 devstack quobyte-client[82814]: System call of process 97333 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:49:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a46ccad6-cc9c-4d7c-aa4c-0685f85a4f71 tempest-CinderUnicodeTest-146879644 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e.6e700fe2-1d67-4700-a460-05bad2f8ed10" returned: 0 in 0.270s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a46ccad6-cc9c-4d7c-aa4c-0685f85a4f71 tempest-CinderUnicodeTest-146879644 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e.6e700fe2-1d67-4700-a460-05bad2f8ed10 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a46ccad6-cc9c-4d7c-aa4c-0685f85a4f71 tempest-CinderUnicodeTest-146879644 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e.6e700fe2-1d67-4700-a460-05bad2f8ed10" returned: 0 in 0.118s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:34 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a46ccad6-cc9c-4d7c-aa4c-0685f85a4f71 tempest-CinderUnicodeTest-146879644 None] Lock "cinder-quobyte-6e700fe2-1d67-4700-a460-05bad2f8ed10" released by "_delete_snapshot" :: held 1.656s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:49:34 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a46ccad6-cc9c-4d7c-aa4c-0685f85a4f71 tempest-CinderUnicodeTest-146879644 None] Lock "cinder-quobyte-86feedc6-4a8b-431c-97e4-0e08ebfb786e" released by "delete_snapshot" :: held 1.704s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:49:34 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-a46ccad6-cc9c-4d7c-aa4c-0685f85a4f71 tempest-CinderUnicodeTest-146879644 None] Created reservations ['8446cbef-ddf9-4b64-a6e3-59e784fb69b1', '5c3bbe8f-6824-45b1-aa37-f611e3559f1b', '1e0f1f84-1ff6-49f8-833e-e5d84b37a156', '025ed863-b985-43a6-8c16-d9f38acc5c00'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:49:34 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-a46ccad6-cc9c-4d7c-aa4c-0685f85a4f71 tempest-CinderUnicodeTest-146879644 None] Delete snapshot completed successfully. Sep 10 15:49:34 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a46ccad6-cc9c-4d7c-aa4c-0685f85a4f71 tempest-CinderUnicodeTest-146879644 None] Lock "cinder-6e700fe2-1d67-4700-a460-05bad2f8ed10-delete_snapshot" released by "delete_snapshot" :: held 2.340s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:49:35 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e7a9553c-4564-4e1c-b2b3-d33a07c04d00 tempest-CinderUnicodeTest-146879644 None] Acquiring lock "cinder-86feedc6-4a8b-431c-97e4-0e08ebfb786e-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:49:35 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e7a9553c-4564-4e1c-b2b3-d33a07c04d00 tempest-CinderUnicodeTest-146879644 None] Lock "cinder-86feedc6-4a8b-431c-97e4-0e08ebfb786e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:49:35 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-e7a9553c-4564-4e1c-b2b3-d33a07c04d00 tempest-CinderUnicodeTest-146879644 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:49:35 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e7a9553c-4564-4e1c-b2b3-d33a07c04d00 tempest-CinderUnicodeTest-146879644 None] Acquiring lock "cinder-quobyte-86feedc6-4a8b-431c-97e4-0e08ebfb786e" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:49:35 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e7a9553c-4564-4e1c-b2b3-d33a07c04d00 tempest-CinderUnicodeTest-146879644 None] Lock "cinder-quobyte-86feedc6-4a8b-431c-97e4-0e08ebfb786e" acquired by "delete_volume" :: waited 0.018s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:49:35 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8c23e3-baac-47c0-82d2-471df3030c6f]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:49:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e7a9553c-4564-4e1c-b2b3-d33a07c04d00 tempest-CinderUnicodeTest-146879644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e7a9553c-4564-4e1c-b2b3-d33a07c04d00 tempest-CinderUnicodeTest-146879644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e" returned: 0 in 0.496s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e7a9553c-4564-4e1c-b2b3-d33a07c04d00 tempest-CinderUnicodeTest-146879644 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e7a9553c-4564-4e1c-b2b3-d33a07c04d00 tempest-CinderUnicodeTest-146879644 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86feedc6-4a8b-431c-97e4-0e08ebfb786e" returned: 0 in 0.120s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:36 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e7a9553c-4564-4e1c-b2b3-d33a07c04d00 tempest-CinderUnicodeTest-146879644 None] Lock "cinder-quobyte-86feedc6-4a8b-431c-97e4-0e08ebfb786e" released by "delete_volume" :: held 0.814s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:49:36 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-e7a9553c-4564-4e1c-b2b3-d33a07c04d00 tempest-CinderUnicodeTest-146879644 None] Created reservations ['9c18f6ff-7a3e-473b-8d66-6579c2d9eb60', 'f8767519-defc-4c80-b7e7-bf9904e41233', 'ab988883-218f-4780-b9ca-1758f0d9f32d', '98088db3-eb8e-4945-9bcc-ceee07d15a28'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:49:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e7a9553c-4564-4e1c-b2b3-d33a07c04d00 tempest-CinderUnicodeTest-146879644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:49:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e7a9553c-4564-4e1c-b2b3-d33a07c04d00 tempest-CinderUnicodeTest-146879644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:49:36 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e7a9553c-4564-4e1c-b2b3-d33a07c04d00 tempest-CinderUnicodeTest-146879644 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:49:36 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e7a9553c-4564-4e1c-b2b3-d33a07c04d00 tempest-CinderUnicodeTest-146879644 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:49:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e7a9553c-4564-4e1c-b2b3-d33a07c04d00 tempest-CinderUnicodeTest-146879644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:49:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e7a9553c-4564-4e1c-b2b3-d33a07c04d00 tempest-CinderUnicodeTest-146879644 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e7a9553c-4564-4e1c-b2b3-d33a07c04d00 tempest-CinderUnicodeTest-146879644 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.372s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:37 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-e7a9553c-4564-4e1c-b2b3-d33a07c04d00 tempest-CinderUnicodeTest-146879644 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:49:37 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-e7a9553c-4564-4e1c-b2b3-d33a07c04d00 tempest-CinderUnicodeTest-146879644 None] Deleted volume successfully. Sep 10 15:49:37 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:49:37 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:49:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Flow 'volume_create_manager' (a1bb1b85-3643-4a69-9116-a2a0c9a56c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:49:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (106753c6-8672-4b9b-91a7-789ae7de6b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (106753c6-8672-4b9b-91a7-789ae7de6b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-191695387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f850ae4d-aaa1-4f95-9669-7973d77a276b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cf89e9083064fda8dc73242a855d30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:49:37Z,use_quota=True,user_id='c93c151c1bce4a66a413f2a3951af44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2673633f-64b4-4d52-9f09-594dc1affbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2673633f-64b4-4d52-9f09-594dc1affbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86aefd5c-1317-447b-9da2-67a10368d168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:37 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-bf2b16df-6085-4e9b-a284-05090efb6349 tempest-CinderUnicodeTest-146879644 None] Acquiring lock "cinder-bfc219a8-827e-4752-8215-2dcfdcfe45aa-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:49:37 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e7a9553c-4564-4e1c-b2b3-d33a07c04d00 tempest-CinderUnicodeTest-146879644 None] Lock "cinder-86feedc6-4a8b-431c-97e4-0e08ebfb786e-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:49:37 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-bf2b16df-6085-4e9b-a284-05090efb6349 tempest-CinderUnicodeTest-146879644 None] Lock "cinder-bfc219a8-827e-4752-8215-2dcfdcfe45aa-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:49:37 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-bf2b16df-6085-4e9b-a284-05090efb6349 tempest-CinderUnicodeTest-146879644 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:49:37 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-bf2b16df-6085-4e9b-a284-05090efb6349 tempest-CinderUnicodeTest-146879644 None] Acquiring lock "cinder-quobyte-bfc219a8-827e-4752-8215-2dcfdcfe45aa" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:49:37 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-bf2b16df-6085-4e9b-a284-05090efb6349 tempest-CinderUnicodeTest-146879644 None] Lock "cinder-quobyte-bfc219a8-827e-4752-8215-2dcfdcfe45aa" acquired by "delete_volume" :: waited 0.024s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:49:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86aefd5c-1317-447b-9da2-67a10368d168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f850ae4d-aaa1-4f95-9669-7973d77a276b', 'volume_name': 'volume-f850ae4d-aaa1-4f95-9669-7973d77a276b', 'volume_size': 1, 'image_id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd75fe9cbcc7343938450d0505f3f0f02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'created_at': datetime.datetime(2025, 9, 10, 13, 6, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 13, 6, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa69f997-7136-4bd6-b8ef-95a111ba2ea1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebef94dc-d321-4d1d-aefe-2f4a17be9f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebef94dc-d321-4d1d-aefe-2f4a17be9f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8323b707-3c9e-4ddb-9f35-5b502c270756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:37 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Volume f850ae4d-aaa1-4f95-9669-7973d77a276b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f850ae4d-aaa1-4f95-9669-7973d77a276b', 'volume_size': 1, 'image_id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd75fe9cbcc7343938450d0505f3f0f02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'created_at': datetime.datetime(2025, 9, 10, 13, 6, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 13, 6, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa69f997-7136-4bd6-b8ef-95a111ba2ea1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 15:49:37 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Cloning f850ae4d-aaa1-4f95-9669-7973d77a276b from image aa69f997-7136-4bd6-b8ef-95a111ba2ea1 at location (None, None). {{(pid=82800) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 15:49:37 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a33cfa-8a2c-4c38-aaaa-0b975a382a0b]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:49:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bf2b16df-6085-4e9b-a284-05090efb6349 tempest-CinderUnicodeTest-146879644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bfc219a8-827e-4752-8215-2dcfdcfe45aa {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:38 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_ojsimsv0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82800) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 15:49:38 devstack cinder-volume[82800]: INFO cinder.image.image_utils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Image download 20.69 MB at 20.69 MB/s Sep 10 15:49:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bf2b16df-6085-4e9b-a284-05090efb6349 tempest-CinderUnicodeTest-146879644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bfc219a8-827e-4752-8215-2dcfdcfe45aa" returned: 0 in 0.683s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bf2b16df-6085-4e9b-a284-05090efb6349 tempest-CinderUnicodeTest-146879644 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bfc219a8-827e-4752-8215-2dcfdcfe45aa {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:38 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[324a79f4-574a-4e61-9e9a-78cf4c7fa27e]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:49:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_ojsimsv0devstack@QuobyteHD {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bf2b16df-6085-4e9b-a284-05090efb6349 tempest-CinderUnicodeTest-146879644 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bfc219a8-827e-4752-8215-2dcfdcfe45aa" returned: 0 in 0.310s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:38 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-bf2b16df-6085-4e9b-a284-05090efb6349 tempest-CinderUnicodeTest-146879644 None] Lock "cinder-quobyte-bfc219a8-827e-4752-8215-2dcfdcfe45aa" released by "delete_volume" :: held 1.208s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:49:39 devstack sudo[97346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_ojsimsv0devstack@QuobyteHD Sep 10 15:49:39 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:49:39 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-bf2b16df-6085-4e9b-a284-05090efb6349 tempest-CinderUnicodeTest-146879644 None] Created reservations ['91a299ef-38bc-4da5-93cf-8f4e4216fa86', 'ec722376-b256-464b-9f8b-bf96453ab013', '3a158125-e7f3-4313-bac7-d7a44d862799', '39f159fd-c5ba-4e8c-899e-940abf1832ac'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:49:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-bf2b16df-6085-4e9b-a284-05090efb6349 tempest-CinderUnicodeTest-146879644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:49:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-bf2b16df-6085-4e9b-a284-05090efb6349 tempest-CinderUnicodeTest-146879644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:49:39 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-bf2b16df-6085-4e9b-a284-05090efb6349 tempest-CinderUnicodeTest-146879644 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:49:39 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-bf2b16df-6085-4e9b-a284-05090efb6349 tempest-CinderUnicodeTest-146879644 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:49:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-bf2b16df-6085-4e9b-a284-05090efb6349 tempest-CinderUnicodeTest-146879644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:49:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bf2b16df-6085-4e9b-a284-05090efb6349 tempest-CinderUnicodeTest-146879644 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bf2b16df-6085-4e9b-a284-05090efb6349 tempest-CinderUnicodeTest-146879644 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.111s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:39 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-bf2b16df-6085-4e9b-a284-05090efb6349 tempest-CinderUnicodeTest-146879644 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:49:39 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-bf2b16df-6085-4e9b-a284-05090efb6349 tempest-CinderUnicodeTest-146879644 None] Deleted volume successfully. Sep 10 15:49:39 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-bf2b16df-6085-4e9b-a284-05090efb6349 tempest-CinderUnicodeTest-146879644 None] Lock "cinder-bfc219a8-827e-4752-8215-2dcfdcfe45aa-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:49:41 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root Sep 10 15:49:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_ojsimsv0devstack@QuobyteHD" returned: 0 in 2.660s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:41 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Temporary image aa69f997-7136-4bd6-b8ef-95a111ba2ea1 is fetched for user c93c151c1bce4a66a413f2a3951af44b. {{(pid=82800) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 15:49:42 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[798d5064-6cb4-4df7-be84-2808bb6c4a9a]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:49:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_ojsimsv0devstack@QuobyteHD {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:42 devstack sudo[97352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_ojsimsv0devstack@QuobyteHD Sep 10 15:49:42 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:49:44 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root Sep 10 15:49:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_ojsimsv0devstack@QuobyteHD" returned: 0 in 2.310s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:49:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:49:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-191695387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f850ae4d-aaa1-4f95-9669-7973d77a276b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cf89e9083064fda8dc73242a855d30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:49:37Z,use_quota=True,user_id='c93c151c1bce4a66a413f2a3951af44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:49:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Creating volume f850ae4d-aaa1-4f95-9669-7973d77a276b {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:49:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:49:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:49:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:49:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:49:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:49:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:49:44 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:49:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:44 devstack quobyte-client[82814]: System call of process 97358 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:49:44 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=127, name=volume-f850ae4d-aaa1-4f95-9669-7973d77a276b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:49:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b 1073741824" returned: 0 in 0.336s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b" returned: 0 in 0.088s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:45 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] <== create_volume: return (518ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:49:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.554s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:49:45 devstack cinder-volume[82800]: DEBUG cinder.volume.volume_utils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Attempting download of aa69f997-7136-4bd6-b8ef-95a111ba2ea1 ((None, None)) to volume f850ae4d-aaa1-4f95-9669-7973d77a276b. {{(pid=82800) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 15:49:45 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[f997f0ff-2129-44e0-8250-be740ea8c6c5]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:49:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_j_47dmbp {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_j_47dmbp" returned: 0 in 0.348s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_j_47dmbp {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_j_47dmbp" returned: 1 in 0.378s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_j_47dmbp' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:49:46 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1debb3-2c28-4e98-908f-ce9ba79cdcd2]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:49:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_ojsimsv0devstack@QuobyteHD {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_ojsimsv0devstack@QuobyteHD" returned: 0 in 0.348s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:46 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] aa69f997-7136-4bd6-b8ef-95a111ba2ea1 was qcow2, converting to raw {{(pid=82800) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 15:49:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_ojsimsv0devstack@QuobyteHD /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:46 devstack quobyte-client[82814]: System call of process 97370 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:49:46 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=127, name=volume-f850ae4d-aaa1-4f95-9669-7973d77a276b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:49:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_ojsimsv0devstack@QuobyteHD /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b" returned: 0 in 1.019s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:47 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_ojsimsv0devstack@QuobyteHD, size 112.00 MB, duration 1.04 sec, destination /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b {{(pid=82800) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 15:49:47 devstack cinder-volume[82800]: INFO cinder.image.image_utils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Converted 112.00 MB image at 107.28 MB/s Sep 10 15:49:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:47 devstack quobyte-client[82814]: System call of process 97376 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:49:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b 1G" returned: 0 in 0.146s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:48 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a3d229-897f-4acd-8fc3-a57c5dc4d9d1]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:49:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b" returned: 0 in 0.415s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b" returned: 1 in 0.536s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:49:49 devstack cinder-volume[82800]: DEBUG cinder.volume.volume_utils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Downloaded image aa69f997-7136-4bd6-b8ef-95a111ba2ea1 ((None, None)) to volume f850ae4d-aaa1-4f95-9669-7973d77a276b successfully. {{(pid=82800) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 15:49:49 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Temporary image aa69f997-7136-4bd6-b8ef-95a111ba2ea1 for user c93c151c1bce4a66a413f2a3951af44b is deleted. {{(pid=82800) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 15:49:49 devstack cinder-volume[82800]: DEBUG cinder.volume.volume_utils [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Marking volume f850ae4d-aaa1-4f95-9669-7973d77a276b as bootable. {{(pid=82800) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 15:49:49 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Copying metadata from image aa69f997-7136-4bd6-b8ef-95a111ba2ea1 to f850ae4d-aaa1-4f95-9669-7973d77a276b. {{(pid=82800) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 15:49:49 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Creating volume glance metadata for volume f850ae4d-aaa1-4f95-9669-7973d77a276b backed by image aa69f997-7136-4bd6-b8ef-95a111ba2ea1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82800) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 15:49:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8323b707-3c9e-4ddb-9f35-5b502c270756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f850ae4d-aaa1-4f95-9669-7973d77a276b', 'volume_size': 1, 'image_id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd75fe9cbcc7343938450d0505f3f0f02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'created_at': datetime.datetime(2025, 9, 10, 13, 6, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 13, 6, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa69f997-7136-4bd6-b8ef-95a111ba2ea1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6301e7-2ee8-4035-b89e-5d96fb3c1d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:49 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Volume volume-f850ae4d-aaa1-4f95-9669-7973d77a276b (f850ae4d-aaa1-4f95-9669-7973d77a276b): created successfully Sep 10 15:49:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa6301e7-2ee8-4035-b89e-5d96fb3c1d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Flow 'volume_create_manager' (a1bb1b85-3643-4a69-9116-a2a0c9a56c30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:49:49 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-3afa0714-cbfd-4b42-9327-ed603e68ffe7 tempest-VolumesExtendTest-1024914473 None] Created volume successfully. Sep 10 15:49:50 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-5175fc69-67bb-4f36-bbf8-868142487445 tempest-VolumesExtendTest-1024914473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:49:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-5175fc69-67bb-4f36-bbf8-868142487445 tempest-VolumesExtendTest-1024914473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:49:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-5175fc69-67bb-4f36-bbf8-868142487445 tempest-VolumesExtendTest-1024914473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:49:50 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f84c66-3aa8-43b6-85fd-78385e6d34f2]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:49:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5175fc69-67bb-4f36-bbf8-868142487445 tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5175fc69-67bb-4f36-bbf8-868142487445 tempest-VolumesExtendTest-1024914473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b" returned: 0 in 0.367s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5175fc69-67bb-4f36-bbf8-868142487445 tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5175fc69-67bb-4f36-bbf8-868142487445 tempest-VolumesExtendTest-1024914473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b" returned: 1 in 0.351s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5175fc69-67bb-4f36-bbf8-868142487445 tempest-VolumesExtendTest-1024914473 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:49:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5175fc69-67bb-4f36-bbf8-868142487445 tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b 2G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5175fc69-67bb-4f36-bbf8-868142487445 tempest-VolumesExtendTest-1024914473 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b 2G" returned: 0 in 0.134s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-5175fc69-67bb-4f36-bbf8-868142487445 tempest-VolumesExtendTest-1024914473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.989s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:49:51 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-5175fc69-67bb-4f36-bbf8-868142487445 tempest-VolumesExtendTest-1024914473 None] Extend volume completed successfully. Sep 10 15:49:52 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-60c53cb1-39f3-4764-922a-3dc1bea0bd55 tempest-VolumesExtendTest-1024914473 None] Acquiring lock "cinder-f850ae4d-aaa1-4f95-9669-7973d77a276b-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:49:52 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-60c53cb1-39f3-4764-922a-3dc1bea0bd55 tempest-VolumesExtendTest-1024914473 None] Lock "cinder-f850ae4d-aaa1-4f95-9669-7973d77a276b-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:49:53 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-60c53cb1-39f3-4764-922a-3dc1bea0bd55 tempest-VolumesExtendTest-1024914473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:49:53 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-60c53cb1-39f3-4764-922a-3dc1bea0bd55 tempest-VolumesExtendTest-1024914473 None] Acquiring lock "cinder-quobyte-f850ae4d-aaa1-4f95-9669-7973d77a276b" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:49:53 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-60c53cb1-39f3-4764-922a-3dc1bea0bd55 tempest-VolumesExtendTest-1024914473 None] Lock "cinder-quobyte-f850ae4d-aaa1-4f95-9669-7973d77a276b" acquired by "delete_volume" :: waited 0.013s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:49:53 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[0122ec8f-8008-486d-8c6d-ca637b205f0a]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:49:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-60c53cb1-39f3-4764-922a-3dc1bea0bd55 tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:53 devstack quobyte-client[82814]: System call of process 97427 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:49:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-60c53cb1-39f3-4764-922a-3dc1bea0bd55 tempest-VolumesExtendTest-1024914473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b" returned: 0 in 0.370s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-60c53cb1-39f3-4764-922a-3dc1bea0bd55 tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-60c53cb1-39f3-4764-922a-3dc1bea0bd55 tempest-VolumesExtendTest-1024914473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b" returned: 1 in 0.376s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-60c53cb1-39f3-4764-922a-3dc1bea0bd55 tempest-VolumesExtendTest-1024914473 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:49:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-60c53cb1-39f3-4764-922a-3dc1bea0bd55 tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-60c53cb1-39f3-4764-922a-3dc1bea0bd55 tempest-VolumesExtendTest-1024914473 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f850ae4d-aaa1-4f95-9669-7973d77a276b" returned: 0 in 0.124s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-60c53cb1-39f3-4764-922a-3dc1bea0bd55 tempest-VolumesExtendTest-1024914473 None] Lock "cinder-quobyte-f850ae4d-aaa1-4f95-9669-7973d77a276b" released by "delete_volume" :: held 1.119s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:49:54 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-60c53cb1-39f3-4764-922a-3dc1bea0bd55 tempest-VolumesExtendTest-1024914473 None] Created reservations ['c6758b64-b9f8-4657-8f03-f3cb52ece56a', 'e015e3ce-4086-4ccc-a5bf-cdcd3cecc995', '68d85630-b0e8-4a10-8b4a-4ccb8a1b4bb5', '686afc53-8f31-40b7-a26a-2f73c345e444'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:49:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-60c53cb1-39f3-4764-922a-3dc1bea0bd55 tempest-VolumesExtendTest-1024914473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:49:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-60c53cb1-39f3-4764-922a-3dc1bea0bd55 tempest-VolumesExtendTest-1024914473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:49:54 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-60c53cb1-39f3-4764-922a-3dc1bea0bd55 tempest-VolumesExtendTest-1024914473 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:49:54 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-60c53cb1-39f3-4764-922a-3dc1bea0bd55 tempest-VolumesExtendTest-1024914473 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:49:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-60c53cb1-39f3-4764-922a-3dc1bea0bd55 tempest-VolumesExtendTest-1024914473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:49:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-60c53cb1-39f3-4764-922a-3dc1bea0bd55 tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-60c53cb1-39f3-4764-922a-3dc1bea0bd55 tempest-VolumesExtendTest-1024914473 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.085s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:54 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-60c53cb1-39f3-4764-922a-3dc1bea0bd55 tempest-VolumesExtendTest-1024914473 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:49:54 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-60c53cb1-39f3-4764-922a-3dc1bea0bd55 tempest-VolumesExtendTest-1024914473 None] Deleted volume successfully. Sep 10 15:49:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-60c53cb1-39f3-4764-922a-3dc1bea0bd55 tempest-VolumesExtendTest-1024914473 None] Lock "cinder-f850ae4d-aaa1-4f95-9669-7973d77a276b-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:49:55 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:49:55 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:49:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Flow 'volume_create_manager' (ba85c621-6b53-4f74-8388-d3d026a1f6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:49:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92b2f51-ba03-4e60-9992-46b36cb0c82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92b2f51-ba03-4e60-9992-46b36cb0c82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-341519765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c2be59-9a5a-463c-a591-f48e43160272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cf89e9083064fda8dc73242a855d30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:49:56Z,use_quota=True,user_id='c93c151c1bce4a66a413f2a3951af44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c554e287-1acf-4d54-90b9-561491170b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c554e287-1acf-4d54-90b9-561491170b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5614dfc3-63f9-402e-be88-2bdffe2b0e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5614dfc3-63f9-402e-be88-2bdffe2b0e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56c2be59-9a5a-463c-a591-f48e43160272', 'volume_name': 'volume-56c2be59-9a5a-463c-a591-f48e43160272', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (906cc143-490e-4dd5-9b9c-dbed5c8c7f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (906cc143-490e-4dd5-9b9c-dbed5c8c7f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:55 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83fd49df-a38d-4e11-9bd4-ddfb475dffa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:55 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Volume 56c2be59-9a5a-463c-a591-f48e43160272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56c2be59-9a5a-463c-a591-f48e43160272', 'volume_size': 1} Sep 10 15:49:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:49:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:49:55 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-341519765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c2be59-9a5a-463c-a591-f48e43160272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cf89e9083064fda8dc73242a855d30a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:49:56Z,use_quota=True,user_id='c93c151c1bce4a66a413f2a3951af44b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:49:55 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Creating volume 56c2be59-9a5a-463c-a591-f48e43160272 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:49:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:49:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:49:55 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:49:55 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:49:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:49:55 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:49:55 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:49:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:56 devstack quobyte-client[82814]: System call of process 97434 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:49:56 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=128, name=volume-56c2be59-9a5a-463c-a591-f48e43160272, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:49:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272 1073741824" returned: 0 in 0.390s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272" returned: 0 in 0.083s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:56 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] <== create_volume: return (534ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:49:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.547s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:49:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83fd49df-a38d-4e11-9bd4-ddfb475dffa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c2be59-9a5a-463c-a591-f48e43160272', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b1b71d-bae9-4c53-885f-02819346a810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:49:56 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Volume volume-56c2be59-9a5a-463c-a591-f48e43160272 (56c2be59-9a5a-463c-a591-f48e43160272): created successfully Sep 10 15:49:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b1b71d-bae9-4c53-885f-02819346a810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:49:56 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Flow 'volume_create_manager' (ba85c621-6b53-4f74-8388-d3d026a1f6cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:49:56 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-277c536f-6e06-4023-8c21-14d1d5744f30 tempest-VolumesExtendTest-1024914473 None] Created volume successfully. Sep 10 15:49:58 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-a1f339e7-d070-4da3-ab23-6e94d89d46ab tempest-VolumesExtendTest-1024914473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:49:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a1f339e7-d070-4da3-ab23-6e94d89d46ab tempest-VolumesExtendTest-1024914473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:49:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a1f339e7-d070-4da3-ab23-6e94d89d46ab tempest-VolumesExtendTest-1024914473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:49:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-a1f339e7-d070-4da3-ab23-6e94d89d46ab tempest-VolumesExtendTest-1024914473 None] Creating offline snapshot af4d6f82-e8d7-4ab8-a9e9-3ecf81dfcfe1 of volume 56c2be59-9a5a-463c-a591-f48e43160272 {{(pid=82800) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 15:49:58 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ee1a9f-8a78-437d-bfd4-a42088836f0e]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:49:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1f339e7-d070-4da3-ab23-6e94d89d46ab tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1f339e7-d070-4da3-ab23-6e94d89d46ab tempest-VolumesExtendTest-1024914473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272" returned: 0 in 0.423s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1f339e7-d070-4da3-ab23-6e94d89d46ab tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272.af4d6f82-e8d7-4ab8-a9e9-3ecf81dfcfe1 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:58 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=129, name=volume-56c2be59-9a5a-463c-a591-f48e43160272.af4d6f82-e8d7-4ab8-a9e9-3ecf81dfcfe1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:49:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1f339e7-d070-4da3-ab23-6e94d89d46ab tempest-VolumesExtendTest-1024914473 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272.af4d6f82-e8d7-4ab8-a9e9-3ecf81dfcfe1 1G" returned: 0 in 0.216s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1f339e7-d070-4da3-ab23-6e94d89d46ab tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): qemu-img rebase -u -b volume-56c2be59-9a5a-463c-a591-f48e43160272 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272.af4d6f82-e8d7-4ab8-a9e9-3ecf81dfcfe1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1f339e7-d070-4da3-ab23-6e94d89d46ab tempest-VolumesExtendTest-1024914473 None] CMD "qemu-img rebase -u -b volume-56c2be59-9a5a-463c-a591-f48e43160272 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272.af4d6f82-e8d7-4ab8-a9e9-3ecf81dfcfe1" returned: 0 in 0.176s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:59 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-a1f339e7-d070-4da3-ab23-6e94d89d46ab tempest-VolumesExtendTest-1024914473 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272.af4d6f82-e8d7-4ab8-a9e9-3ecf81dfcfe1 is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:49:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1f339e7-d070-4da3-ab23-6e94d89d46ab tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272.af4d6f82-e8d7-4ab8-a9e9-3ecf81dfcfe1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1f339e7-d070-4da3-ab23-6e94d89d46ab tempest-VolumesExtendTest-1024914473 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272.af4d6f82-e8d7-4ab8-a9e9-3ecf81dfcfe1" returned: 0 in 0.129s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:59 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-a1f339e7-d070-4da3-ab23-6e94d89d46ab tempest-VolumesExtendTest-1024914473 None] Setting permissions: /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272 -> 1000:1000 {{(pid=82800) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 15:49:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1f339e7-d070-4da3-ab23-6e94d89d46ab tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272.af4d6f82-e8d7-4ab8-a9e9-3ecf81dfcfe1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1f339e7-d070-4da3-ab23-6e94d89d46ab tempest-VolumesExtendTest-1024914473 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272.af4d6f82-e8d7-4ab8-a9e9-3ecf81dfcfe1" returned: 0 in 0.109s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1f339e7-d070-4da3-ab23-6e94d89d46ab tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1f339e7-d070-4da3-ab23-6e94d89d46ab tempest-VolumesExtendTest-1024914473 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272.info" returned: 0 in 0.147s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:59 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-a1f339e7-d070-4da3-ab23-6e94d89d46ab tempest-VolumesExtendTest-1024914473 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272.info is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:49:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1f339e7-d070-4da3-ab23-6e94d89d46ab tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:49:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a1f339e7-d070-4da3-ab23-6e94d89d46ab tempest-VolumesExtendTest-1024914473 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272.info" returned: 0 in 0.137s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:49:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a1f339e7-d070-4da3-ab23-6e94d89d46ab tempest-VolumesExtendTest-1024914473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.757s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:50:00 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=108,cinder:DELETE=10,cinder:SELECT=80,cinder:INSERT=25 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:50:00 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-a1f339e7-d070-4da3-ab23-6e94d89d46ab tempest-VolumesExtendTest-1024914473 None] Create snapshot completed successfully Sep 10 15:50:01 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-7c9dab6c-5257-42fb-9eb9-83a0564d934b tempest-VolumesExtendTest-1024914473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:50:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7c9dab6c-5257-42fb-9eb9-83a0564d934b tempest-VolumesExtendTest-1024914473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:50:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7c9dab6c-5257-42fb-9eb9-83a0564d934b tempest-VolumesExtendTest-1024914473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:50:01 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e7961e-f4a3-4991-8370-7a1bb576962d]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:50:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7c9dab6c-5257-42fb-9eb9-83a0564d934b tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:50:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7c9dab6c-5257-42fb-9eb9-83a0564d934b tempest-VolumesExtendTest-1024914473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272" returned: 0 in 0.521s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:50:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7c9dab6c-5257-42fb-9eb9-83a0564d934b tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272.af4d6f82-e8d7-4ab8-a9e9-3ecf81dfcfe1 2G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:50:02 devstack quobyte-client[82814]: System call of process 97454 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:50:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-7c9dab6c-5257-42fb-9eb9-83a0564d934b tempest-VolumesExtendTest-1024914473 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272.af4d6f82-e8d7-4ab8-a9e9-3ecf81dfcfe1 2G" returned: 0 in 0.427s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:50:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-7c9dab6c-5257-42fb-9eb9-83a0564d934b tempest-VolumesExtendTest-1024914473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.077s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:50:03 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-7c9dab6c-5257-42fb-9eb9-83a0564d934b tempest-VolumesExtendTest-1024914473 None] Extend volume completed successfully. Sep 10 15:50:04 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-faf3f238-f459-495b-b238-52619694cb6a tempest-VolumesExtendTest-1024914473 None] Acquiring lock "cinder-af4d6f82-e8d7-4ab8-a9e9-3ecf81dfcfe1-delete_snapshot" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:50:04 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-faf3f238-f459-495b-b238-52619694cb6a tempest-VolumesExtendTest-1024914473 None] Lock "cinder-af4d6f82-e8d7-4ab8-a9e9-3ecf81dfcfe1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.100s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:50:04 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-faf3f238-f459-495b-b238-52619694cb6a tempest-VolumesExtendTest-1024914473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:50:04 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-faf3f238-f459-495b-b238-52619694cb6a tempest-VolumesExtendTest-1024914473 None] Acquiring lock "cinder-quobyte-56c2be59-9a5a-463c-a591-f48e43160272" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:50:04 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-faf3f238-f459-495b-b238-52619694cb6a tempest-VolumesExtendTest-1024914473 None] Lock "cinder-quobyte-56c2be59-9a5a-463c-a591-f48e43160272" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:50:04 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-faf3f238-f459-495b-b238-52619694cb6a tempest-VolumesExtendTest-1024914473 None] Acquiring lock "cinder-quobyte-af4d6f82-e8d7-4ab8-a9e9-3ecf81dfcfe1" by "_delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:50:04 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-faf3f238-f459-495b-b238-52619694cb6a tempest-VolumesExtendTest-1024914473 None] Lock "cinder-quobyte-af4d6f82-e8d7-4ab8-a9e9-3ecf81dfcfe1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:50:04 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-faf3f238-f459-495b-b238-52619694cb6a tempest-VolumesExtendTest-1024914473 None] Deleting offline snapshot af4d6f82-e8d7-4ab8-a9e9-3ecf81dfcfe1 of volume 56c2be59-9a5a-463c-a591-f48e43160272 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 15:50:04 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-faf3f238-f459-495b-b238-52619694cb6a tempest-VolumesExtendTest-1024914473 None] snapshot_file for this snap is: volume-56c2be59-9a5a-463c-a591-f48e43160272.af4d6f82-e8d7-4ab8-a9e9-3ecf81dfcfe1 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 15:50:04 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c340bb-bcc7-4eb8-adcb-e4c740c53916]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:50:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-faf3f238-f459-495b-b238-52619694cb6a tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272.af4d6f82-e8d7-4ab8-a9e9-3ecf81dfcfe1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:50:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-faf3f238-f459-495b-b238-52619694cb6a tempest-VolumesExtendTest-1024914473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272.af4d6f82-e8d7-4ab8-a9e9-3ecf81dfcfe1" returned: 0 in 0.446s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:50:05 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-faf3f238-f459-495b-b238-52619694cb6a tempest-VolumesExtendTest-1024914473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56c2be59-9a5a-463c-a591-f48e43160272(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:50:05 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[349f7f1b-85c3-41ac-a301-a8f3e5386e80]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:50:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-faf3f238-f459-495b-b238-52619694cb6a tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:50:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-faf3f238-f459-495b-b238-52619694cb6a tempest-VolumesExtendTest-1024914473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272" returned: 0 in 0.430s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:50:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-faf3f238-f459-495b-b238-52619694cb6a tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272.af4d6f82-e8d7-4ab8-a9e9-3ecf81dfcfe1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:50:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-faf3f238-f459-495b-b238-52619694cb6a tempest-VolumesExtendTest-1024914473 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272.af4d6f82-e8d7-4ab8-a9e9-3ecf81dfcfe1" returned: 0 in 0.259s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:50:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-faf3f238-f459-495b-b238-52619694cb6a tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272.af4d6f82-e8d7-4ab8-a9e9-3ecf81dfcfe1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:50:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-faf3f238-f459-495b-b238-52619694cb6a tempest-VolumesExtendTest-1024914473 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272.af4d6f82-e8d7-4ab8-a9e9-3ecf81dfcfe1" returned: 0 in 0.100s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:50:06 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-faf3f238-f459-495b-b238-52619694cb6a tempest-VolumesExtendTest-1024914473 None] Lock "cinder-quobyte-af4d6f82-e8d7-4ab8-a9e9-3ecf81dfcfe1" released by "_delete_snapshot" :: held 1.536s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:50:06 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-faf3f238-f459-495b-b238-52619694cb6a tempest-VolumesExtendTest-1024914473 None] Lock "cinder-quobyte-56c2be59-9a5a-463c-a591-f48e43160272" released by "delete_snapshot" :: held 1.566s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:50:06 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-faf3f238-f459-495b-b238-52619694cb6a tempest-VolumesExtendTest-1024914473 None] Created reservations ['5d0be9c4-8f3f-4b53-a3ef-797ed80b2f7f', '2307dac7-d5c3-4151-9a41-f21057d5841f', '94a7949f-b193-4c05-9658-4fddf7adbe1c', '7de33015-41b0-4fcf-a1b2-fb264e0466fa'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:50:06 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-faf3f238-f459-495b-b238-52619694cb6a tempest-VolumesExtendTest-1024914473 None] Delete snapshot completed successfully. Sep 10 15:50:06 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-faf3f238-f459-495b-b238-52619694cb6a tempest-VolumesExtendTest-1024914473 None] Lock "cinder-af4d6f82-e8d7-4ab8-a9e9-3ecf81dfcfe1-delete_snapshot" released by "delete_snapshot" :: held 2.002s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:50:07 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9931b586-00c8-43a2-830d-3551d088428a tempest-VolumesExtendTest-1024914473 None] Acquiring lock "cinder-56c2be59-9a5a-463c-a591-f48e43160272-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:50:07 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9931b586-00c8-43a2-830d-3551d088428a tempest-VolumesExtendTest-1024914473 None] Lock "cinder-56c2be59-9a5a-463c-a591-f48e43160272-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:50:07 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-9931b586-00c8-43a2-830d-3551d088428a tempest-VolumesExtendTest-1024914473 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:50:07 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9931b586-00c8-43a2-830d-3551d088428a tempest-VolumesExtendTest-1024914473 None] Acquiring lock "cinder-quobyte-56c2be59-9a5a-463c-a591-f48e43160272" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:50:07 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9931b586-00c8-43a2-830d-3551d088428a tempest-VolumesExtendTest-1024914473 None] Lock "cinder-quobyte-56c2be59-9a5a-463c-a591-f48e43160272" acquired by "delete_volume" :: waited 0.015s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:50:07 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[0180b88d-acf2-46df-9596-27417acf601f]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:50:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9931b586-00c8-43a2-830d-3551d088428a tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:50:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9931b586-00c8-43a2-830d-3551d088428a tempest-VolumesExtendTest-1024914473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272" returned: 0 in 0.406s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:50:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9931b586-00c8-43a2-830d-3551d088428a tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:50:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9931b586-00c8-43a2-830d-3551d088428a tempest-VolumesExtendTest-1024914473 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-56c2be59-9a5a-463c-a591-f48e43160272" returned: 0 in 0.106s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:50:08 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9931b586-00c8-43a2-830d-3551d088428a tempest-VolumesExtendTest-1024914473 None] Lock "cinder-quobyte-56c2be59-9a5a-463c-a591-f48e43160272" released by "delete_volume" :: held 0.675s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:50:08 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-9931b586-00c8-43a2-830d-3551d088428a tempest-VolumesExtendTest-1024914473 None] Created reservations ['3ff7ccf7-5ff3-4c21-8a3b-9327cc503f63', 'c62f4a47-cd7b-4a65-9cce-853e7c51ab82', '15a466e9-1abe-4b66-94cb-0e0f28e51cbf', '940233fd-7431-4301-a27d-bbda4ef00a4c'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:50:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-9931b586-00c8-43a2-830d-3551d088428a tempest-VolumesExtendTest-1024914473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:50:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-9931b586-00c8-43a2-830d-3551d088428a tempest-VolumesExtendTest-1024914473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:50:08 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-9931b586-00c8-43a2-830d-3551d088428a tempest-VolumesExtendTest-1024914473 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:50:08 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-9931b586-00c8-43a2-830d-3551d088428a tempest-VolumesExtendTest-1024914473 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:50:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-9931b586-00c8-43a2-830d-3551d088428a tempest-VolumesExtendTest-1024914473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:50:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9931b586-00c8-43a2-830d-3551d088428a tempest-VolumesExtendTest-1024914473 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:50:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9931b586-00c8-43a2-830d-3551d088428a tempest-VolumesExtendTest-1024914473 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.091s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:50:09 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-9931b586-00c8-43a2-830d-3551d088428a tempest-VolumesExtendTest-1024914473 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:50:09 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-9931b586-00c8-43a2-830d-3551d088428a tempest-VolumesExtendTest-1024914473 None] Deleted volume successfully. Sep 10 15:50:09 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9931b586-00c8-43a2-830d-3551d088428a tempest-VolumesExtendTest-1024914473 None] Lock "cinder-56c2be59-9a5a-463c-a591-f48e43160272-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:50:16 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:50:16 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:50:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Flow 'volume_create_manager' (891085fe-c364-4af0-b33a-e571b0c93963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:50:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67079c5b-c9f4-4565-9804-4dcd65759469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:50:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67079c5b-c9f4-4565-9804-4dcd65759469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-643007095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c91e9c9-c6f0-4d83-9474-16dec79bb037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39fa6b285cf2454b9d6f5771f37b7a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:50:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:50:16Z,use_quota=True,user_id='8043cec062ec427d83ce8a8a3118089d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:50:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b0ebd7-4b18-4367-ba49-9cbd8d8c4287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:50:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b0ebd7-4b18-4367-ba49-9cbd8d8c4287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:50:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fd9c57-fa79-4644-95da-907452545654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:50:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fd9c57-fa79-4644-95da-907452545654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c91e9c9-c6f0-4d83-9474-16dec79bb037', 'volume_name': 'volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037', 'volume_size': 2}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:50:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66a9392-a9eb-44cc-9918-4c8ee21ae6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:50:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f66a9392-a9eb-44cc-9918-4c8ee21ae6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:50:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23179341-124b-41a4-a2dc-04d64ada9efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:50:16 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Volume 8c91e9c9-c6f0-4d83-9474-16dec79bb037: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037', 'volume_size': 2} Sep 10 15:50:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:50:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:50:16 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-643007095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c91e9c9-c6f0-4d83-9474-16dec79bb037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39fa6b285cf2454b9d6f5771f37b7a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:50:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:50:16Z,use_quota=True,user_id='8043cec062ec427d83ce8a8a3118089d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:50:16 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Creating volume 8c91e9c9-c6f0-4d83-9474-16dec79bb037 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:50:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:50:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:50:16 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:50:16 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:50:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:50:16 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:50:16 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:50:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037 2147483648 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:50:16 devstack quobyte-client[82814]: System call of process 97482 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:50:16 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=131, name=volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:50:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037 2147483648" returned: 0 in 0.530s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:50:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:50:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037" returned: 0 in 0.140s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:50:17 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] <== create_volume: return (757ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:50:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:50:17 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23179341-124b-41a4-a2dc-04d64ada9efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037', 'volume_size': 2}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:50:17 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a80c6f-6f22-445b-8186-53a1856e533f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:50:17 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Volume volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037 (8c91e9c9-c6f0-4d83-9474-16dec79bb037): created successfully Sep 10 15:50:17 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a80c6f-6f22-445b-8186-53a1856e533f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:50:17 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Flow 'volume_create_manager' (891085fe-c364-4af0-b33a-e571b0c93963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:50:17 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-0afa938b-52a9-4ec1-b9b6-e5368e0de777 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Created volume successfully. Sep 10 15:50:18 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-3709233b-8518-40df-9a23-da43da7fb2ce tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:50:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-3709233b-8518-40df-9a23-da43da7fb2ce tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:50:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-3709233b-8518-40df-9a23-da43da7fb2ce tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:50:18 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-3709233b-8518-40df-9a23-da43da7fb2ce tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Creating offline snapshot 76368b8c-93cf-451c-89f1-481bcd6b2055 of volume 8c91e9c9-c6f0-4d83-9474-16dec79bb037 {{(pid=82800) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 15:50:18 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[6039a175-616d-46de-9312-2b95157e790a]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:50:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3709233b-8518-40df-9a23-da43da7fb2ce tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:50:19 devstack quobyte-client[82814]: System call of process 97487 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:50:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3709233b-8518-40df-9a23-da43da7fb2ce tempest-VolumesSnapshotNegativeTestJSON-447358953 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037" returned: 0 in 0.473s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:50:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3709233b-8518-40df-9a23-da43da7fb2ce tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037.76368b8c-93cf-451c-89f1-481bcd6b2055 2G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:50:19 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=132, name=volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037.76368b8c-93cf-451c-89f1-481bcd6b2055, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:50:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3709233b-8518-40df-9a23-da43da7fb2ce tempest-VolumesSnapshotNegativeTestJSON-447358953 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037.76368b8c-93cf-451c-89f1-481bcd6b2055 2G" returned: 0 in 0.370s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:50:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3709233b-8518-40df-9a23-da43da7fb2ce tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Running cmd (subprocess): qemu-img rebase -u -b volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037.76368b8c-93cf-451c-89f1-481bcd6b2055 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:50:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3709233b-8518-40df-9a23-da43da7fb2ce tempest-VolumesSnapshotNegativeTestJSON-447358953 None] CMD "qemu-img rebase -u -b volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037.76368b8c-93cf-451c-89f1-481bcd6b2055" returned: 0 in 0.162s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:50:19 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-3709233b-8518-40df-9a23-da43da7fb2ce tempest-VolumesSnapshotNegativeTestJSON-447358953 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037.76368b8c-93cf-451c-89f1-481bcd6b2055 is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:50:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3709233b-8518-40df-9a23-da43da7fb2ce tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037.76368b8c-93cf-451c-89f1-481bcd6b2055 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:50:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3709233b-8518-40df-9a23-da43da7fb2ce tempest-VolumesSnapshotNegativeTestJSON-447358953 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037.76368b8c-93cf-451c-89f1-481bcd6b2055" returned: 0 in 0.136s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:50:19 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-3709233b-8518-40df-9a23-da43da7fb2ce tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Setting permissions: /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037 -> 1000:1000 {{(pid=82800) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 15:50:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3709233b-8518-40df-9a23-da43da7fb2ce tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037.76368b8c-93cf-451c-89f1-481bcd6b2055 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:50:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3709233b-8518-40df-9a23-da43da7fb2ce tempest-VolumesSnapshotNegativeTestJSON-447358953 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037.76368b8c-93cf-451c-89f1-481bcd6b2055" returned: 0 in 0.093s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:50:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3709233b-8518-40df-9a23-da43da7fb2ce tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:50:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3709233b-8518-40df-9a23-da43da7fb2ce tempest-VolumesSnapshotNegativeTestJSON-447358953 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037.info" returned: 0 in 0.099s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:50:20 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-3709233b-8518-40df-9a23-da43da7fb2ce tempest-VolumesSnapshotNegativeTestJSON-447358953 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037.info is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:50:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3709233b-8518-40df-9a23-da43da7fb2ce tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:50:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3709233b-8518-40df-9a23-da43da7fb2ce tempest-VolumesSnapshotNegativeTestJSON-447358953 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037.info" returned: 0 in 0.087s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:50:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-3709233b-8518-40df-9a23-da43da7fb2ce tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.809s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:50:20 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-3709233b-8518-40df-9a23-da43da7fb2ce tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Create snapshot completed successfully Sep 10 15:50:21 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-58253dee-9792-4fda-8736-849e90398afe tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Acquiring lock "cinder-76368b8c-93cf-451c-89f1-481bcd6b2055-delete_snapshot" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:50:21 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-58253dee-9792-4fda-8736-849e90398afe tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Lock "cinder-76368b8c-93cf-451c-89f1-481bcd6b2055-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:50:21 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-58253dee-9792-4fda-8736-849e90398afe tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:50:21 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-58253dee-9792-4fda-8736-849e90398afe tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Acquiring lock "cinder-quobyte-8c91e9c9-c6f0-4d83-9474-16dec79bb037" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:50:21 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-58253dee-9792-4fda-8736-849e90398afe tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Lock "cinder-quobyte-8c91e9c9-c6f0-4d83-9474-16dec79bb037" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:50:21 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-58253dee-9792-4fda-8736-849e90398afe tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Acquiring lock "cinder-quobyte-76368b8c-93cf-451c-89f1-481bcd6b2055" by "_delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:50:21 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-58253dee-9792-4fda-8736-849e90398afe tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Lock "cinder-quobyte-76368b8c-93cf-451c-89f1-481bcd6b2055" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:50:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-58253dee-9792-4fda-8736-849e90398afe tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Deleting offline snapshot 76368b8c-93cf-451c-89f1-481bcd6b2055 of volume 8c91e9c9-c6f0-4d83-9474-16dec79bb037 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 15:50:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-58253dee-9792-4fda-8736-849e90398afe tempest-VolumesSnapshotNegativeTestJSON-447358953 None] snapshot_file for this snap is: volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037.76368b8c-93cf-451c-89f1-481bcd6b2055 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 15:50:21 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[f560bfec-4b76-41ab-b8a4-0e3534c2bd20]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:50:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-58253dee-9792-4fda-8736-849e90398afe tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037.76368b8c-93cf-451c-89f1-481bcd6b2055 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:50:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-58253dee-9792-4fda-8736-849e90398afe tempest-VolumesSnapshotNegativeTestJSON-447358953 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037.76368b8c-93cf-451c-89f1-481bcd6b2055" returned: 0 in 0.425s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:50:22 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-58253dee-9792-4fda-8736-849e90398afe tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:50:22 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b23fb9b-f96a-43cd-8444-8386747bb575]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:50:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-58253dee-9792-4fda-8736-849e90398afe tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:50:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-58253dee-9792-4fda-8736-849e90398afe tempest-VolumesSnapshotNegativeTestJSON-447358953 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037" returned: 0 in 0.433s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:50:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-58253dee-9792-4fda-8736-849e90398afe tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037.76368b8c-93cf-451c-89f1-481bcd6b2055 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:50:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-58253dee-9792-4fda-8736-849e90398afe tempest-VolumesSnapshotNegativeTestJSON-447358953 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037.76368b8c-93cf-451c-89f1-481bcd6b2055" returned: 0 in 0.296s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:50:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-58253dee-9792-4fda-8736-849e90398afe tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037.76368b8c-93cf-451c-89f1-481bcd6b2055 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:50:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-58253dee-9792-4fda-8736-849e90398afe tempest-VolumesSnapshotNegativeTestJSON-447358953 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037.76368b8c-93cf-451c-89f1-481bcd6b2055" returned: 0 in 0.087s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:50:23 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-58253dee-9792-4fda-8736-849e90398afe tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Lock "cinder-quobyte-76368b8c-93cf-451c-89f1-481bcd6b2055" released by "_delete_snapshot" :: held 1.567s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:50:23 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-58253dee-9792-4fda-8736-849e90398afe tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Lock "cinder-quobyte-8c91e9c9-c6f0-4d83-9474-16dec79bb037" released by "delete_snapshot" :: held 1.591s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:50:23 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-58253dee-9792-4fda-8736-849e90398afe tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Created reservations ['be8d8741-2d69-4243-ae53-9fd7d33d0995', 'f33ff5aa-44f7-44b8-be83-f34ce0eaf620', '68337163-2161-4ffc-8008-3526bae87d87', '074a8e02-a3b1-4403-9cfe-c69cebd3ee18'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:50:23 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-58253dee-9792-4fda-8736-849e90398afe tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Delete snapshot completed successfully. Sep 10 15:50:23 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-58253dee-9792-4fda-8736-849e90398afe tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Lock "cinder-76368b8c-93cf-451c-89f1-481bcd6b2055-delete_snapshot" released by "delete_snapshot" :: held 2.101s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:50:25 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e7291425-ce8b-4571-9a0f-d0c795af2bd0 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Acquiring lock "cinder-8c91e9c9-c6f0-4d83-9474-16dec79bb037-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:50:25 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e7291425-ce8b-4571-9a0f-d0c795af2bd0 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Lock "cinder-8c91e9c9-c6f0-4d83-9474-16dec79bb037-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:50:25 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-e7291425-ce8b-4571-9a0f-d0c795af2bd0 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:50:25 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e7291425-ce8b-4571-9a0f-d0c795af2bd0 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Acquiring lock "cinder-quobyte-8c91e9c9-c6f0-4d83-9474-16dec79bb037" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:50:25 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e7291425-ce8b-4571-9a0f-d0c795af2bd0 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Lock "cinder-quobyte-8c91e9c9-c6f0-4d83-9474-16dec79bb037" acquired by "delete_volume" :: waited 0.011s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:50:25 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2554ec4-214c-4800-bde8-56c0e32165c7]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:50:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e7291425-ce8b-4571-9a0f-d0c795af2bd0 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:50:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e7291425-ce8b-4571-9a0f-d0c795af2bd0 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037" returned: 0 in 0.403s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:50:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e7291425-ce8b-4571-9a0f-d0c795af2bd0 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:50:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e7291425-ce8b-4571-9a0f-d0c795af2bd0 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c91e9c9-c6f0-4d83-9474-16dec79bb037" returned: 0 in 0.104s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:50:25 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e7291425-ce8b-4571-9a0f-d0c795af2bd0 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Lock "cinder-quobyte-8c91e9c9-c6f0-4d83-9474-16dec79bb037" released by "delete_volume" :: held 0.660s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:50:26 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=87,cinder:SELECT=64,cinder:DELETE=7,cinder:INSERT=22 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:50:26 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-e7291425-ce8b-4571-9a0f-d0c795af2bd0 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Created reservations ['0d314960-59ef-4338-83a0-f3f88267a84a', '6d47888e-24cb-49b4-8bf6-a1da4ffea207', '65c48773-afcf-43eb-935c-0bfbb3b91aa9', '250afcd7-b867-4142-a3fa-dd2c2d363a16'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:50:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e7291425-ce8b-4571-9a0f-d0c795af2bd0 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:50:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e7291425-ce8b-4571-9a0f-d0c795af2bd0 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:50:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e7291425-ce8b-4571-9a0f-d0c795af2bd0 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:50:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e7291425-ce8b-4571-9a0f-d0c795af2bd0 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:50:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e7291425-ce8b-4571-9a0f-d0c795af2bd0 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:50:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e7291425-ce8b-4571-9a0f-d0c795af2bd0 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:50:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e7291425-ce8b-4571-9a0f-d0c795af2bd0 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.101s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:50:26 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-e7291425-ce8b-4571-9a0f-d0c795af2bd0 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:50:26 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-e7291425-ce8b-4571-9a0f-d0c795af2bd0 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Deleted volume successfully. Sep 10 15:50:26 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e7291425-ce8b-4571-9a0f-d0c795af2bd0 tempest-VolumesSnapshotNegativeTestJSON-447358953 None] Lock "cinder-8c91e9c9-c6f0-4d83-9474-16dec79bb037-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:50:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:50:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:50:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:50:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:50:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:50:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:50:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:50:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.127s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:50:30 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:50:36 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=24,cinder:SELECT=21,cinder:INSERT=12,cinder:DELETE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:50:36 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:INSERT=1,cinder:UPDATE=7,cinder:SELECT=1,cinder:DELETE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:51:08 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:51:24 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:51:24 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:51:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Flow 'volume_create_manager' (bc2b6159-57f0-4a63-a131-04572d6a27fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:51:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a285f829-d4ee-40e2-b77c-d8a6fcb2c653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:51:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a285f829-d4ee-40e2-b77c-d8a6fcb2c653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-342470569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fcfd063-8a6b-439d-b7dd-203689b1915f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d92f4ff1934aed822215e09750da6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:51:24Z,use_quota=True,user_id='48c58165e2cb4e5b820254ab7c685d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:51:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b984e68-a12f-424d-b2d5-978dff5ef900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:51:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b984e68-a12f-424d-b2d5-978dff5ef900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:51:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aabc5d5-041d-4437-9214-d1b9b50e6991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:51:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aabc5d5-041d-4437-9214-d1b9b50e6991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fcfd063-8a6b-439d-b7dd-203689b1915f', 'volume_name': 'volume-7fcfd063-8a6b-439d-b7dd-203689b1915f', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:51:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e889df1e-704f-4006-8a08-a895c84e3b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:51:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e889df1e-704f-4006-8a08-a895c84e3b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:51:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d02eea-99e9-45e1-b4b8-440c3ada28ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:51:24 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Volume 7fcfd063-8a6b-439d-b7dd-203689b1915f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fcfd063-8a6b-439d-b7dd-203689b1915f', 'volume_size': 1} Sep 10 15:51:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:51:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:51:24 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-342470569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fcfd063-8a6b-439d-b7dd-203689b1915f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43d92f4ff1934aed822215e09750da6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:51:24Z,use_quota=True,user_id='48c58165e2cb4e5b820254ab7c685d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:51:24 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Creating volume 7fcfd063-8a6b-439d-b7dd-203689b1915f {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:51:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:51:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:51:24 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:51:24 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:51:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:51:24 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:51:24 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:51:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7fcfd063-8a6b-439d-b7dd-203689b1915f 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:51:25 devstack quobyte-client[82814]: System call of process 97688 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:51:25 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=134, name=volume-7fcfd063-8a6b-439d-b7dd-203689b1915f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:51:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7fcfd063-8a6b-439d-b7dd-203689b1915f 1073741824" returned: 0 in 0.471s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:51:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7fcfd063-8a6b-439d-b7dd-203689b1915f {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:51:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7fcfd063-8a6b-439d-b7dd-203689b1915f" returned: 0 in 0.169s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:51:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] <== create_volume: return (735ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:51:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:51:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d02eea-99e9-45e1-b4b8-440c3ada28ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fcfd063-8a6b-439d-b7dd-203689b1915f', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:51:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a1dc78-ea23-4c52-b759-fe6c476c3a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:51:25 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Volume volume-7fcfd063-8a6b-439d-b7dd-203689b1915f (7fcfd063-8a6b-439d-b7dd-203689b1915f): created successfully Sep 10 15:51:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a1dc78-ea23-4c52-b759-fe6c476c3a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:51:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Flow 'volume_create_manager' (bc2b6159-57f0-4a63-a131-04572d6a27fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:51:25 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-49c6a29e-2893-43a8-b72a-04aa13a4ede1 tempest-TestMinimumBasicScenario-526981915 None] Created volume successfully. Sep 10 15:51:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:51:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:51:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:51:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:51:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:51:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:51:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:51:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.269s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:51:30 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:51:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-c03f4e35-239f-426d-9618-88d49214c8f2 req-84a0ff24-4e26-44de-a111-cb1ce6b6d654 tempest-TestMinimumBasicScenario-526981915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:51:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-c03f4e35-239f-426d-9618-88d49214c8f2 req-84a0ff24-4e26-44de-a111-cb1ce6b6d654 tempest-TestMinimumBasicScenario-526981915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:51:31 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b05b3b-320f-490b-861b-7e15a6e09621]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:51:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-c03f4e35-239f-426d-9618-88d49214c8f2 req-84a0ff24-4e26-44de-a111-cb1ce6b6d654 tempest-TestMinimumBasicScenario-526981915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7fcfd063-8a6b-439d-b7dd-203689b1915f {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:51:31 devstack quobyte-client[82814]: System call of process 97701 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:51:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-c03f4e35-239f-426d-9618-88d49214c8f2 req-84a0ff24-4e26-44de-a111-cb1ce6b6d654 tempest-TestMinimumBasicScenario-526981915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7fcfd063-8a6b-439d-b7dd-203689b1915f" returned: 0 in 0.563s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:51:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-c03f4e35-239f-426d-9618-88d49214c8f2 req-84a0ff24-4e26-44de-a111-cb1ce6b6d654 tempest-TestMinimumBasicScenario-526981915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.673s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:51:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-c03f4e35-239f-426d-9618-88d49214c8f2 req-84a0ff24-4e26-44de-a111-cb1ce6b6d654 tempest-TestMinimumBasicScenario-526981915 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5', 'name': 'volume-7fcfd063-8a6b-439d-b7dd-203689b1915f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f029c94a-085b-4eac-b8f1-93c2970fdc29', 'enforce_multipath': True} {{(pid=82800) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 15:51:32 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-c03f4e35-239f-426d-9618-88d49214c8f2 req-84a0ff24-4e26-44de-a111-cb1ce6b6d654 tempest-TestMinimumBasicScenario-526981915 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:51:32 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-c03f4e35-239f-426d-9618-88d49214c8f2 req-84a0ff24-4e26-44de-a111-cb1ce6b6d654 tempest-TestMinimumBasicScenario-526981915 None] attachment_update completed successfully. Sep 10 15:51:42 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:51:42 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=5,cinder:DELETE=1,cinder:SELECT=5 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:52:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:52:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:52:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:52:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:52:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:52:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:52:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:52:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.196s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:52:30 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:53:08 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:53:08 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:53:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:53:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:53:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:53:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:53:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:53:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:53:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:53:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.113s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:53:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:54:05 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-5d7b8959-ce67-4e41-b6c7-d9236628dc49 req-16b0e466-8171-41e3-ad4f-4a21dc8b046c tempest-TestMinimumBasicScenario-526981915 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:54:05 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-5d7b8959-ce67-4e41-b6c7-d9236628dc49 req-16b0e466-8171-41e3-ad4f-4a21dc8b046c tempest-TestMinimumBasicScenario-526981915 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:54:05 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-5d7b8959-ce67-4e41-b6c7-d9236628dc49 req-16b0e466-8171-41e3-ad4f-4a21dc8b046c tempest-TestMinimumBasicScenario-526981915 None] Terminate volume connection completed successfully. Sep 10 15:54:05 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-5d7b8959-ce67-4e41-b6c7-d9236628dc49 req-16b0e466-8171-41e3-ad4f-4a21dc8b046c tempest-TestMinimumBasicScenario-526981915 None] Deleting attachment f029c94a-085b-4eac-b8f1-93c2970fdc29. {{(pid=82800) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 15:54:06 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ec50983c-a13a-41f4-89d9-9a17bdec0322 tempest-TestMinimumBasicScenario-526981915 None] Acquiring lock "cinder-7fcfd063-8a6b-439d-b7dd-203689b1915f-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:54:06 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ec50983c-a13a-41f4-89d9-9a17bdec0322 tempest-TestMinimumBasicScenario-526981915 None] Lock "cinder-7fcfd063-8a6b-439d-b7dd-203689b1915f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:54:06 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-ec50983c-a13a-41f4-89d9-9a17bdec0322 tempest-TestMinimumBasicScenario-526981915 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:54:06 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ec50983c-a13a-41f4-89d9-9a17bdec0322 tempest-TestMinimumBasicScenario-526981915 None] Acquiring lock "cinder-quobyte-7fcfd063-8a6b-439d-b7dd-203689b1915f" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:54:06 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ec50983c-a13a-41f4-89d9-9a17bdec0322 tempest-TestMinimumBasicScenario-526981915 None] Lock "cinder-quobyte-7fcfd063-8a6b-439d-b7dd-203689b1915f" acquired by "delete_volume" :: waited 0.013s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:54:06 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61bd632-0c32-496e-aff7-9b84617c72af]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:54:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ec50983c-a13a-41f4-89d9-9a17bdec0322 tempest-TestMinimumBasicScenario-526981915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7fcfd063-8a6b-439d-b7dd-203689b1915f {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:54:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ec50983c-a13a-41f4-89d9-9a17bdec0322 tempest-TestMinimumBasicScenario-526981915 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7fcfd063-8a6b-439d-b7dd-203689b1915f" returned: 0 in 0.433s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:54:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ec50983c-a13a-41f4-89d9-9a17bdec0322 tempest-TestMinimumBasicScenario-526981915 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7fcfd063-8a6b-439d-b7dd-203689b1915f {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:54:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ec50983c-a13a-41f4-89d9-9a17bdec0322 tempest-TestMinimumBasicScenario-526981915 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-7fcfd063-8a6b-439d-b7dd-203689b1915f" returned: 0 in 0.090s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:54:07 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ec50983c-a13a-41f4-89d9-9a17bdec0322 tempest-TestMinimumBasicScenario-526981915 None] Lock "cinder-quobyte-7fcfd063-8a6b-439d-b7dd-203689b1915f" released by "delete_volume" :: held 0.693s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:54:07 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-ec50983c-a13a-41f4-89d9-9a17bdec0322 tempest-TestMinimumBasicScenario-526981915 None] Created reservations ['7d6a7fdf-3d00-4a41-8070-d4ab0f467fd4', '514136dc-de9e-4538-bac8-46c0b4c0a9f5', 'c30c1a19-c236-4abc-a535-dbf7c2b29530', 'fd88ed1b-00c9-47f9-9461-d0af4c9eb07d'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:54:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ec50983c-a13a-41f4-89d9-9a17bdec0322 tempest-TestMinimumBasicScenario-526981915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:54:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ec50983c-a13a-41f4-89d9-9a17bdec0322 tempest-TestMinimumBasicScenario-526981915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:54:07 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-ec50983c-a13a-41f4-89d9-9a17bdec0322 tempest-TestMinimumBasicScenario-526981915 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:54:07 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-ec50983c-a13a-41f4-89d9-9a17bdec0322 tempest-TestMinimumBasicScenario-526981915 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:54:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ec50983c-a13a-41f4-89d9-9a17bdec0322 tempest-TestMinimumBasicScenario-526981915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:54:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ec50983c-a13a-41f4-89d9-9a17bdec0322 tempest-TestMinimumBasicScenario-526981915 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:54:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ec50983c-a13a-41f4-89d9-9a17bdec0322 tempest-TestMinimumBasicScenario-526981915 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.085s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:54:07 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-ec50983c-a13a-41f4-89d9-9a17bdec0322 tempest-TestMinimumBasicScenario-526981915 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:54:07 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-ec50983c-a13a-41f4-89d9-9a17bdec0322 tempest-TestMinimumBasicScenario-526981915 None] Deleted volume successfully. Sep 10 15:54:08 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ec50983c-a13a-41f4-89d9-9a17bdec0322 tempest-TestMinimumBasicScenario-526981915 None] Lock "cinder-7fcfd063-8a6b-439d-b7dd-203689b1915f-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:54:17 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:54:18 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:54:58 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:54:58 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:54:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Flow 'volume_create_manager' (96972d9b-a6fb-4b29-a4b5-c1222e742e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:54:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2ccc4f-2e79-47ab-af4e-74571d9ce120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:54:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2ccc4f-2e79-47ab-af4e-74571d9ce120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2121096882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e9522f-20df-4519-97dc-6a4926fb75e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0b6c6dd1894dc29b279ab524944014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:54:59Z,use_quota=True,user_id='2041d0dcfc0849ee99480ba910eb4763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:54:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60636d9-9ce4-4404-988e-2fc43c9da94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:54:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a60636d9-9ce4-4404-988e-2fc43c9da94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:54:58 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc788790-de01-476d-a611-2d8cd94ffccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:54:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc788790-de01-476d-a611-2d8cd94ffccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '79e9522f-20df-4519-97dc-6a4926fb75e0', 'volume_name': 'volume-79e9522f-20df-4519-97dc-6a4926fb75e0', 'volume_size': 1, 'image_id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd75fe9cbcc7343938450d0505f3f0f02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'created_at': datetime.datetime(2025, 9, 10, 13, 6, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 13, 6, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa69f997-7136-4bd6-b8ef-95a111ba2ea1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:54:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0668e738-6afa-4523-bbd9-dd322a1f3200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:54:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0668e738-6afa-4523-bbd9-dd322a1f3200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:54:59 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748f25b0-42a1-4201-8d47-e228d16dd551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:54:59 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Volume 79e9522f-20df-4519-97dc-6a4926fb75e0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-79e9522f-20df-4519-97dc-6a4926fb75e0', 'volume_size': 1, 'image_id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd75fe9cbcc7343938450d0505f3f0f02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'created_at': datetime.datetime(2025, 9, 10, 13, 6, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 13, 6, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa69f997-7136-4bd6-b8ef-95a111ba2ea1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 10 15:54:59 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Cloning 79e9522f-20df-4519-97dc-6a4926fb75e0 from image aa69f997-7136-4bd6-b8ef-95a111ba2ea1 at location (None, None). {{(pid=82800) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 15:54:59 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_6g9mg0dddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82800) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 15:54:59 devstack cinder-volume[82800]: INFO cinder.image.image_utils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Image download 20.69 MB at 20.69 MB/s Sep 10 15:54:59 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ba95d9-8106-423e-bcba-97b284c93a10]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:54:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_6g9mg0dddevstack@QuobyteHD {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:54:59 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_6g9mg0dddevstack@QuobyteHD Sep 10 15:54:59 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:55:01 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Sep 10 15:55:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_6g9mg0dddevstack@QuobyteHD" returned: 0 in 1.913s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:55:01 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Temporary image aa69f997-7136-4bd6-b8ef-95a111ba2ea1 is fetched for user 2041d0dcfc0849ee99480ba910eb4763. {{(pid=82800) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 15:55:01 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[019b95d1-a2cf-4d2b-b524-4885ad5d116f]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:55:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_6g9mg0dddevstack@QuobyteHD {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:55:02 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_6g9mg0dddevstack@QuobyteHD Sep 10 15:55:02 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 15:55:03 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Sep 10 15:55:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_6g9mg0dddevstack@QuobyteHD" returned: 0 in 1.892s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:55:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:55:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:55:03 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2121096882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e9522f-20df-4519-97dc-6a4926fb75e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0b6c6dd1894dc29b279ab524944014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:54:59Z,use_quota=True,user_id='2041d0dcfc0849ee99480ba910eb4763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:55:03 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Creating volume 79e9522f-20df-4519-97dc-6a4926fb75e0 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:55:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:55:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:55:03 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:55:03 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:55:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:55:03 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:55:03 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:55:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:55:03 devstack quobyte-client[82814]: System call of process 98626 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:55:03 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=135, name=volume-79e9522f-20df-4519-97dc-6a4926fb75e0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:55:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0 1073741824" returned: 0 in 0.387s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:55:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:55:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0" returned: 0 in 0.087s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:55:04 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] <== create_volume: return (562ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:55:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.594s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:55:04 devstack cinder-volume[82800]: DEBUG cinder.volume.volume_utils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Attempting download of aa69f997-7136-4bd6-b8ef-95a111ba2ea1 ((None, None)) to volume 79e9522f-20df-4519-97dc-6a4926fb75e0. {{(pid=82800) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 15:55:04 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9861f27-7547-40f8-ae9d-a712d35ca27f]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:55:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_aanqls5q {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:55:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_aanqls5q" returned: 0 in 0.339s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:55:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_aanqls5q {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:55:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_aanqls5q" returned: 1 in 0.357s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:55:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_aanqls5q' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:55:05 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4898ce-e682-4151-90ff-77bc8d1e1da2]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:55:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_6g9mg0dddevstack@QuobyteHD {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:55:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_6g9mg0dddevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:55:05 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] aa69f997-7136-4bd6-b8ef-95a111ba2ea1 was qcow2, converting to raw {{(pid=82800) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 15:55:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_6g9mg0dddevstack@QuobyteHD /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:55:05 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=135, name=volume-79e9522f-20df-4519-97dc-6a4926fb75e0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:55:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_6g9mg0dddevstack@QuobyteHD /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0" returned: 0 in 1.040s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:55:06 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aa69f997-7136-4bd6-b8ef-95a111ba2ea1_6g9mg0dddevstack@QuobyteHD, size 112.00 MB, duration 1.06 sec, destination /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0 {{(pid=82800) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 15:55:06 devstack cinder-volume[82800]: INFO cinder.image.image_utils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Converted 112.00 MB image at 105.25 MB/s Sep 10 15:55:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:55:06 devstack quobyte-client[82814]: System call of process 98643 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:55:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0 1G" returned: 0 in 0.117s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:55:07 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be140f6-66f9-4a89-89df-0c6190ac915f]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:55:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:55:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0" returned: 0 in 0.423s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:55:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:55:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0" returned: 1 in 0.423s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:55:08 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:55:08 devstack cinder-volume[82800]: DEBUG cinder.volume.volume_utils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Downloaded image aa69f997-7136-4bd6-b8ef-95a111ba2ea1 ((None, None)) to volume 79e9522f-20df-4519-97dc-6a4926fb75e0 successfully. {{(pid=82800) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 15:55:08 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Temporary image aa69f997-7136-4bd6-b8ef-95a111ba2ea1 for user 2041d0dcfc0849ee99480ba910eb4763 is deleted. {{(pid=82800) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 15:55:08 devstack cinder-volume[82800]: DEBUG cinder.volume.volume_utils [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Marking volume 79e9522f-20df-4519-97dc-6a4926fb75e0 as bootable. {{(pid=82800) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 15:55:08 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Copying metadata from image aa69f997-7136-4bd6-b8ef-95a111ba2ea1 to 79e9522f-20df-4519-97dc-6a4926fb75e0. {{(pid=82800) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 15:55:08 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Creating volume glance metadata for volume 79e9522f-20df-4519-97dc-6a4926fb75e0 backed by image aa69f997-7136-4bd6-b8ef-95a111ba2ea1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82800) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 15:55:08 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748f25b0-42a1-4201-8d47-e228d16dd551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79e9522f-20df-4519-97dc-6a4926fb75e0', 'volume_size': 1, 'image_id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd75fe9cbcc7343938450d0505f3f0f02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'aa69f997-7136-4bd6-b8ef-95a111ba2ea1', 'created_at': datetime.datetime(2025, 9, 10, 13, 6, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 13, 6, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aa69f997-7136-4bd6-b8ef-95a111ba2ea1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:55:08 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3110e7a-1f56-4d11-aa58-ea742386e93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:55:08 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Volume volume-79e9522f-20df-4519-97dc-6a4926fb75e0 (79e9522f-20df-4519-97dc-6a4926fb75e0): created successfully Sep 10 15:55:08 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3110e7a-1f56-4d11-aa58-ea742386e93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:55:08 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Flow 'volume_create_manager' (96972d9b-a6fb-4b29-a4b5-c1222e742e78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:55:08 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-6051483c-d190-4bd4-9028-bf71f2692614 tempest-TestShelveInstance-2103822537 None] Created volume successfully. Sep 10 15:55:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-471b3a5a-f363-4006-8cac-b8d4ea6d84db req-e9f859f5-61d8-49bb-8d79-0710e47d6606 tempest-TestShelveInstance-2103822537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:55:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-471b3a5a-f363-4006-8cac-b8d4ea6d84db req-e9f859f5-61d8-49bb-8d79-0710e47d6606 tempest-TestShelveInstance-2103822537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:55:18 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[957fd563-0783-4f87-a81b-65003ae6154b]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:55:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-471b3a5a-f363-4006-8cac-b8d4ea6d84db req-e9f859f5-61d8-49bb-8d79-0710e47d6606 tempest-TestShelveInstance-2103822537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:55:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-471b3a5a-f363-4006-8cac-b8d4ea6d84db req-e9f859f5-61d8-49bb-8d79-0710e47d6606 tempest-TestShelveInstance-2103822537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0" returned: 0 in 0.393s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:55:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-471b3a5a-f363-4006-8cac-b8d4ea6d84db req-e9f859f5-61d8-49bb-8d79-0710e47d6606 tempest-TestShelveInstance-2103822537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:55:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-471b3a5a-f363-4006-8cac-b8d4ea6d84db req-e9f859f5-61d8-49bb-8d79-0710e47d6606 tempest-TestShelveInstance-2103822537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0" returned: 1 in 0.417s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:55:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-471b3a5a-f363-4006-8cac-b8d4ea6d84db req-e9f859f5-61d8-49bb-8d79-0710e47d6606 tempest-TestShelveInstance-2103822537 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:55:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-471b3a5a-f363-4006-8cac-b8d4ea6d84db req-e9f859f5-61d8-49bb-8d79-0710e47d6606 tempest-TestShelveInstance-2103822537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.937s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:55:19 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-471b3a5a-f363-4006-8cac-b8d4ea6d84db req-e9f859f5-61d8-49bb-8d79-0710e47d6606 tempest-TestShelveInstance-2103822537 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5', 'name': 'volume-79e9522f-20df-4519-97dc-6a4926fb75e0', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ba86bf8-5b0f-4b37-9822-7b5b12fc403d', 'enforce_multipath': True} {{(pid=82800) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 15:55:19 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-471b3a5a-f363-4006-8cac-b8d4ea6d84db req-e9f859f5-61d8-49bb-8d79-0710e47d6606 tempest-TestShelveInstance-2103822537 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:55:19 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-471b3a5a-f363-4006-8cac-b8d4ea6d84db req-e9f859f5-61d8-49bb-8d79-0710e47d6606 tempest-TestShelveInstance-2103822537 None] attachment_update completed successfully. Sep 10 15:55:29 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=6,cinder:SELECT=16,cinder:INSERT=6 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:55:29 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=13,cinder:UPDATE=5,cinder:INSERT=7,cinder:DELETE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:55:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:55:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:55:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:55:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:55:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:55:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:55:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:55:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.176s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:55:30 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:56:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:56:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:56:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:56:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:56:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:56:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:56:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:56:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.158s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:56:30 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:56:51 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-1a6330f3-bae2-450b-8668-de2f83908d86 req-55c7d3c3-5afd-4a0d-b371-e52d229b2ea4 tempest-TestShelveInstance-2103822537 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:56:51 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-1a6330f3-bae2-450b-8668-de2f83908d86 req-55c7d3c3-5afd-4a0d-b371-e52d229b2ea4 tempest-TestShelveInstance-2103822537 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:56:51 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-1a6330f3-bae2-450b-8668-de2f83908d86 req-55c7d3c3-5afd-4a0d-b371-e52d229b2ea4 tempest-TestShelveInstance-2103822537 None] Terminate volume connection completed successfully. Sep 10 15:56:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-1a6330f3-bae2-450b-8668-de2f83908d86 req-55c7d3c3-5afd-4a0d-b371-e52d229b2ea4 tempest-TestShelveInstance-2103822537 None] Deleting attachment 3ba86bf8-5b0f-4b37-9822-7b5b12fc403d. {{(pid=82800) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 15:56:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-767abb0c-bb90-43b0-9ba8-553210c09f50 req-f7ee043a-aed2-4486-a0a1-68590c1dec84 tempest-TestShelveInstance-2103822537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:56:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-767abb0c-bb90-43b0-9ba8-553210c09f50 req-f7ee043a-aed2-4486-a0a1-68590c1dec84 tempest-TestShelveInstance-2103822537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:56:56 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6f9d32-65a0-4638-a078-1b80a2b2c92a]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:56:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-767abb0c-bb90-43b0-9ba8-553210c09f50 req-f7ee043a-aed2-4486-a0a1-68590c1dec84 tempest-TestShelveInstance-2103822537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:56:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-767abb0c-bb90-43b0-9ba8-553210c09f50 req-f7ee043a-aed2-4486-a0a1-68590c1dec84 tempest-TestShelveInstance-2103822537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0" returned: 0 in 0.400s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:56:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-767abb0c-bb90-43b0-9ba8-553210c09f50 req-f7ee043a-aed2-4486-a0a1-68590c1dec84 tempest-TestShelveInstance-2103822537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:56:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-767abb0c-bb90-43b0-9ba8-553210c09f50 req-f7ee043a-aed2-4486-a0a1-68590c1dec84 tempest-TestShelveInstance-2103822537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0" returned: 1 in 0.371s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:56:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-767abb0c-bb90-43b0-9ba8-553210c09f50 req-f7ee043a-aed2-4486-a0a1-68590c1dec84 tempest-TestShelveInstance-2103822537 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:56:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-767abb0c-bb90-43b0-9ba8-553210c09f50 req-f7ee043a-aed2-4486-a0a1-68590c1dec84 tempest-TestShelveInstance-2103822537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.951s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:56:57 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-767abb0c-bb90-43b0-9ba8-553210c09f50 req-f7ee043a-aed2-4486-a0a1-68590c1dec84 tempest-TestShelveInstance-2103822537 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5', 'name': 'volume-79e9522f-20df-4519-97dc-6a4926fb75e0', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '318ed66e-0e38-4f3f-8f07-8feec59d7766', 'enforce_multipath': True} {{(pid=82800) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 10 15:56:57 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-767abb0c-bb90-43b0-9ba8-553210c09f50 req-f7ee043a-aed2-4486-a0a1-68590c1dec84 tempest-TestShelveInstance-2103822537 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:56:57 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-767abb0c-bb90-43b0-9ba8-553210c09f50 req-f7ee043a-aed2-4486-a0a1-68590c1dec84 tempest-TestShelveInstance-2103822537 None] attachment_update completed successfully. Sep 10 15:57:08 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:57:08 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:57:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:57:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:57:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:57:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:57:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:57:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:57:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:57:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.088s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:57:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:58:28 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-cac1042b-7c3c-4fbb-bf27-5f3044a43384 tempest-TestShelveInstance-2103822537 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:58:28 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-cac1042b-7c3c-4fbb-bf27-5f3044a43384 tempest-TestShelveInstance-2103822537 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:58:28 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-cac1042b-7c3c-4fbb-bf27-5f3044a43384 tempest-TestShelveInstance-2103822537 None] Terminate volume connection completed successfully. Sep 10 15:58:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-cac1042b-7c3c-4fbb-bf27-5f3044a43384 tempest-TestShelveInstance-2103822537 None] Deleting attachment 318ed66e-0e38-4f3f-8f07-8feec59d7766. {{(pid=82800) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 10 15:58:28 devstack cinder-volume[82800]: DEBUG cinder.coordination [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-40ebc4a1-7cd9-46f5-869f-50a624052442 tempest-TestShelveInstance-2103822537 None] Acquiring lock "cinder-79e9522f-20df-4519-97dc-6a4926fb75e0-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:58:28 devstack cinder-volume[82800]: DEBUG cinder.coordination [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-40ebc4a1-7cd9-46f5-869f-50a624052442 tempest-TestShelveInstance-2103822537 None] Lock "cinder-79e9522f-20df-4519-97dc-6a4926fb75e0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:58:28 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-40ebc4a1-7cd9-46f5-869f-50a624052442 tempest-TestShelveInstance-2103822537 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:58:28 devstack cinder-volume[82800]: DEBUG cinder.coordination [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-40ebc4a1-7cd9-46f5-869f-50a624052442 tempest-TestShelveInstance-2103822537 None] Acquiring lock "cinder-quobyte-79e9522f-20df-4519-97dc-6a4926fb75e0" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:58:28 devstack cinder-volume[82800]: DEBUG cinder.coordination [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-40ebc4a1-7cd9-46f5-869f-50a624052442 tempest-TestShelveInstance-2103822537 None] Lock "cinder-quobyte-79e9522f-20df-4519-97dc-6a4926fb75e0" acquired by "delete_volume" :: waited 0.024s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:58:29 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[30da6c96-4aca-400e-bfbe-d2af93f5a198]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:58:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-40ebc4a1-7cd9-46f5-869f-50a624052442 tempest-TestShelveInstance-2103822537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:58:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-40ebc4a1-7cd9-46f5-869f-50a624052442 tempest-TestShelveInstance-2103822537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0" returned: 0 in 0.390s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:58:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-40ebc4a1-7cd9-46f5-869f-50a624052442 tempest-TestShelveInstance-2103822537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:58:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:58:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:58:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:58:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:58:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:58:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:58:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:58:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-40ebc4a1-7cd9-46f5-869f-50a624052442 tempest-TestShelveInstance-2103822537 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0" returned: 1 in 0.507s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:58:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-40ebc4a1-7cd9-46f5-869f-50a624052442 tempest-TestShelveInstance-2103822537 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 15:58:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-40ebc4a1-7cd9-46f5-869f-50a624052442 tempest-TestShelveInstance-2103822537 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:58:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.240s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:58:30 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:58:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-40ebc4a1-7cd9-46f5-869f-50a624052442 tempest-TestShelveInstance-2103822537 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-79e9522f-20df-4519-97dc-6a4926fb75e0" returned: 0 in 0.176s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:58:30 devstack cinder-volume[82800]: DEBUG cinder.coordination [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-40ebc4a1-7cd9-46f5-869f-50a624052442 tempest-TestShelveInstance-2103822537 None] Lock "cinder-quobyte-79e9522f-20df-4519-97dc-6a4926fb75e0" released by "delete_volume" :: held 1.322s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:58:30 devstack cinder-volume[82800]: DEBUG cinder.quota [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-40ebc4a1-7cd9-46f5-869f-50a624052442 tempest-TestShelveInstance-2103822537 None] Created reservations ['53014e33-9ea2-4b77-8f66-971eef0338b0', '76b0111e-a7a3-49fb-9183-206ca5e2aff1', '4483e6fa-f0da-411d-bdf0-31cd26728a59', '719bc28f-a35b-4cc5-a175-c478979979ac'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:58:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-40ebc4a1-7cd9-46f5-869f-50a624052442 tempest-TestShelveInstance-2103822537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:58:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-40ebc4a1-7cd9-46f5-869f-50a624052442 tempest-TestShelveInstance-2103822537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:58:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-40ebc4a1-7cd9-46f5-869f-50a624052442 tempest-TestShelveInstance-2103822537 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:58:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-40ebc4a1-7cd9-46f5-869f-50a624052442 tempest-TestShelveInstance-2103822537 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:58:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-40ebc4a1-7cd9-46f5-869f-50a624052442 tempest-TestShelveInstance-2103822537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:58:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-40ebc4a1-7cd9-46f5-869f-50a624052442 tempest-TestShelveInstance-2103822537 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:58:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-40ebc4a1-7cd9-46f5-869f-50a624052442 tempest-TestShelveInstance-2103822537 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.085s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:58:30 devstack cinder-volume[82800]: DEBUG cinder.manager [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-40ebc4a1-7cd9-46f5-869f-50a624052442 tempest-TestShelveInstance-2103822537 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:58:30 devstack cinder-volume[82800]: INFO cinder.volume.manager [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-40ebc4a1-7cd9-46f5-869f-50a624052442 tempest-TestShelveInstance-2103822537 None] Deleted volume successfully. Sep 10 15:58:31 devstack cinder-volume[82800]: DEBUG cinder.coordination [req-f4b452de-4a8e-40a8-b40b-c56943dceb90 req-40ebc4a1-7cd9-46f5-869f-50a624052442 tempest-TestShelveInstance-2103822537 None] Lock "cinder-79e9522f-20df-4519-97dc-6a4926fb75e0-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:58:40 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=4,cinder:UPDATE=14,cinder:INSERT=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:58:40 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=8,cinder:INSERT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:58:46 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:58:46 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:58:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Flow 'volume_create_manager' (f8171110-2dfc-4616-afad-44fa48bac665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:58:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa02141-fbb3-4381-bbdf-77f63b845fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fa02141-fbb3-4381-bbdf-77f63b845fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-308242242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84472748-f195-4c80-8336-0c1b83739f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e1a733774e474590220160aa979506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:58:46Z,use_quota=True,user_id='6b8d452529ce4f8c8f70bbe5e4994f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f26196-586e-45bd-b53b-9c2e84b30851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0f26196-586e-45bd-b53b-9c2e84b30851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50827c1d-2243-4757-a71e-af83a081b938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50827c1d-2243-4757-a71e-af83a081b938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84472748-f195-4c80-8336-0c1b83739f31', 'volume_name': 'volume-84472748-f195-4c80-8336-0c1b83739f31', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc2d839-ea30-4305-a782-534018d73e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc2d839-ea30-4305-a782-534018d73e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f8686a-61f0-4885-a30f-fc143a7d7bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:46 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume 84472748-f195-4c80-8336-0c1b83739f31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84472748-f195-4c80-8336-0c1b83739f31', 'volume_size': 1} Sep 10 15:58:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:58:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:58:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-308242242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84472748-f195-4c80-8336-0c1b83739f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e1a733774e474590220160aa979506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:58:46Z,use_quota=True,user_id='6b8d452529ce4f8c8f70bbe5e4994f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:58:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Creating volume 84472748-f195-4c80-8336-0c1b83739f31 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:58:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:58:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:58:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:58:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:58:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:58:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:58:46 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:58:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-84472748-f195-4c80-8336-0c1b83739f31 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:58:46 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=136, name=volume-84472748-f195-4c80-8336-0c1b83739f31, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:58:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-84472748-f195-4c80-8336-0c1b83739f31 1073741824" returned: 0 in 0.331s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:58:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-84472748-f195-4c80-8336-0c1b83739f31 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:58:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-84472748-f195-4c80-8336-0c1b83739f31" returned: 0 in 0.085s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:58:47 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] <== create_volume: return (475ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:58:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.486s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:58:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f8686a-61f0-4885-a30f-fc143a7d7bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84472748-f195-4c80-8336-0c1b83739f31', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (658ffe23-7182-47bf-b019-7fb197243592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:47 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume volume-84472748-f195-4c80-8336-0c1b83739f31 (84472748-f195-4c80-8336-0c1b83739f31): created successfully Sep 10 15:58:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (658ffe23-7182-47bf-b019-7fb197243592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Flow 'volume_create_manager' (f8171110-2dfc-4616-afad-44fa48bac665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:58:47 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-d86e37b4-546e-4d22-b888-c4653d253805 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Created volume successfully. Sep 10 15:58:48 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:58:48 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:58:48 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Flow 'volume_create_manager' (125a239d-ec5b-4728-83d5-8c63f9fb978c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:58:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b1a0cc9-2f5c-4b37-b5fb-d67f617b08ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b1a0cc9-2f5c-4b37-b5fb-d67f617b08ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1940895596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccaa444c-811c-4135-8fe7-5998c74863b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e1a733774e474590220160aa979506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:58:49Z,use_quota=True,user_id='6b8d452529ce4f8c8f70bbe5e4994f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834577f7-5afd-4282-be1b-b3f5169e095f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834577f7-5afd-4282-be1b-b3f5169e095f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc547039-3569-4912-8fd3-d3cdcf98bbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc547039-3569-4912-8fd3-d3cdcf98bbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccaa444c-811c-4135-8fe7-5998c74863b5', 'volume_name': 'volume-ccaa444c-811c-4135-8fe7-5998c74863b5', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1389563a-8ae6-4494-9e90-f28aee8db4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1389563a-8ae6-4494-9e90-f28aee8db4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:49 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a06e81fd-ce75-4277-a343-7755a8619a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:49 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume ccaa444c-811c-4135-8fe7-5998c74863b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccaa444c-811c-4135-8fe7-5998c74863b5', 'volume_size': 1} Sep 10 15:58:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:58:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:58:49 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1940895596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccaa444c-811c-4135-8fe7-5998c74863b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e1a733774e474590220160aa979506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:58:49Z,use_quota=True,user_id='6b8d452529ce4f8c8f70bbe5e4994f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:58:49 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Creating volume ccaa444c-811c-4135-8fe7-5998c74863b5 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:58:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:58:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:58:49 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:58:49 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:58:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:58:49 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:58:49 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:58:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ccaa444c-811c-4135-8fe7-5998c74863b5 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:58:49 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=137, name=volume-ccaa444c-811c-4135-8fe7-5998c74863b5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:58:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ccaa444c-811c-4135-8fe7-5998c74863b5 1073741824" returned: 0 in 0.562s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:58:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ccaa444c-811c-4135-8fe7-5998c74863b5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:58:49 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:58:49 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Flow 'volume_create_manager' (33e5f747-db90-4c12-9e3e-227928a317e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745e48f2-4bef-45b7-856e-2de4654e245a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ccaa444c-811c-4135-8fe7-5998c74863b5" returned: 0 in 0.595s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] <== create_volume: return (1199ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745e48f2-4bef-45b7-856e-2de4654e245a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1069018000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f77d89d8-94da-4feb-9ca4-9dddd0805f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e1a733774e474590220160aa979506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:58:49Z,use_quota=True,user_id='6b8d452529ce4f8c8f70bbe5e4994f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78499f5f-d020-476e-a2dd-9754e96c0d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78499f5f-d020-476e-a2dd-9754e96c0d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd20bbf-ab74-40e2-8d8b-b58c06bc2609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd20bbf-ab74-40e2-8d8b-b58c06bc2609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f77d89d8-94da-4feb-9ca4-9dddd0805f8d', 'volume_name': 'volume-f77d89d8-94da-4feb-9ca4-9dddd0805f8d', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde272d0-2471-4cb7-9a8a-a43cf93106e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde272d0-2471-4cb7-9a8a-a43cf93106e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a98555-5205-49c9-ab83-1a21c4f301c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:50 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume f77d89d8-94da-4feb-9ca4-9dddd0805f8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f77d89d8-94da-4feb-9ca4-9dddd0805f8d', 'volume_size': 1} Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1069018000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f77d89d8-94da-4feb-9ca4-9dddd0805f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e1a733774e474590220160aa979506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:58:49Z,use_quota=True,user_id='6b8d452529ce4f8c8f70bbe5e4994f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Creating volume f77d89d8-94da-4feb-9ca4-9dddd0805f8d {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:58:50 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f77d89d8-94da-4feb-9ca4-9dddd0805f8d 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:58:50 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=138, name=volume-f77d89d8-94da-4feb-9ca4-9dddd0805f8d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a06e81fd-ce75-4277-a343-7755a8619a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccaa444c-811c-4135-8fe7-5998c74863b5', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac62a3d-5355-4d52-b461-806662a59911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:50 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Flow 'volume_create_manager' (e37014c2-7ea3-490a-aeb5-bf9da86f5f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388ab477-27d0-42cc-8acb-1c5a57359c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:50 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume volume-ccaa444c-811c-4135-8fe7-5998c74863b5 (ccaa444c-811c-4135-8fe7-5998c74863b5): created successfully Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac62a3d-5355-4d52-b461-806662a59911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Flow 'volume_create_manager' (125a239d-ec5b-4728-83d5-8c63f9fb978c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:58:50 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:58:50 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Flow 'volume_create_manager' (4c53c43a-9b89-44d4-9631-1e699b014faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6932af19-d5ed-4a19-b00f-f17d8f1fdcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6932af19-d5ed-4a19-b00f-f17d8f1fdcee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-234049471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5d61db-0097-4739-a1dc-37ab04ebe373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e1a733774e474590220160aa979506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:58:50Z,use_quota=True,user_id='6b8d452529ce4f8c8f70bbe5e4994f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c980517d-20ca-45df-92fa-f44a9c79f70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c980517d-20ca-45df-92fa-f44a9c79f70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2adeb70a-e3f0-4866-8f53-bad4e426d38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2adeb70a-e3f0-4866-8f53-bad4e426d38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb5d61db-0097-4739-a1dc-37ab04ebe373', 'volume_name': 'volume-eb5d61db-0097-4739-a1dc-37ab04ebe373', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677ce8cd-de18-4d30-b77d-8dfcd3eb5ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677ce8cd-de18-4d30-b77d-8dfcd3eb5ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc3ad850-cfe3-4d35-afee-e7e7280daab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:51 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume eb5d61db-0097-4739-a1dc-37ab04ebe373: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb5d61db-0097-4739-a1dc-37ab04ebe373', 'volume_size': 1} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:58:51 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-e562f631-bbc9-4959-9dfa-fe30baed3c3c tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Created volume successfully. Sep 10 15:58:51 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Flow 'volume_create_manager' (60824d3b-c9dc-4cf6-a005-ba6bfb6826d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f725209-f177-4a88-9ddf-fb2fdea4175f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f725209-f177-4a88-9ddf-fb2fdea4175f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1237787936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6d77150-a642-4eaf-91b4-8fc663b467a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e1a733774e474590220160aa979506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:58:51Z,use_quota=True,user_id='6b8d452529ce4f8c8f70bbe5e4994f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699667f8-b22b-4fd3-8f6e-317ed5ea5731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699667f8-b22b-4fd3-8f6e-317ed5ea5731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8da732-944a-45f3-9d67-8439c70af42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8da732-944a-45f3-9d67-8439c70af42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6d77150-a642-4eaf-91b4-8fc663b467a6', 'volume_name': 'volume-b6d77150-a642-4eaf-91b4-8fc663b467a6', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1456aaf3-fdee-4427-ae4a-02f016b42ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1456aaf3-fdee-4427-ae4a-02f016b42ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d59a478f-66e2-4fcb-ae9b-533030454023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:51 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume b6d77150-a642-4eaf-91b4-8fc663b467a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6d77150-a642-4eaf-91b4-8fc663b467a6', 'volume_size': 1} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388ab477-27d0-42cc-8acb-1c5a57359c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1390408383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9430f7be-9272-4db8-83be-2c188eeba559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e1a733774e474590220160aa979506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:58:50Z,use_quota=True,user_id='6b8d452529ce4f8c8f70bbe5e4994f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db29d8f7-2ffe-4528-a300-6575ec93f662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db29d8f7-2ffe-4528-a300-6575ec93f662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f5f691-58b8-4972-a65d-7f0c2f018007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f5f691-58b8-4972-a65d-7f0c2f018007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9430f7be-9272-4db8-83be-2c188eeba559', 'volume_name': 'volume-9430f7be-9272-4db8-83be-2c188eeba559', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (823779d0-ff97-45bb-bd82-a31edb98ff47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (823779d0-ff97-45bb-bd82-a31edb98ff47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (039c0e13-2c3f-4553-b0e6-dd3a5f8c7ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:51 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume 9430f7be-9272-4db8-83be-2c188eeba559: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9430f7be-9272-4db8-83be-2c188eeba559', 'volume_size': 1} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f77d89d8-94da-4feb-9ca4-9dddd0805f8d 1073741824" returned: 0 in 0.833s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f77d89d8-94da-4feb-9ca4-9dddd0805f8d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f77d89d8-94da-4feb-9ca4-9dddd0805f8d" returned: 0 in 0.097s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] <== create_volume: return (971ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.372s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-234049471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5d61db-0097-4739-a1dc-37ab04ebe373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e1a733774e474590220160aa979506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:58:50Z,use_quota=True,user_id='6b8d452529ce4f8c8f70bbe5e4994f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Creating volume eb5d61db-0097-4739-a1dc-37ab04ebe373 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:58:51 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-eb5d61db-0097-4739-a1dc-37ab04ebe373 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:58:51 devstack quobyte-client[82814]: System call of process 100216 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:58:51 devstack quobyte-client[82814]: System call of process 100216 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:58:51 devstack quobyte-client[82814]: System call of process 100216 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:58:51 devstack quobyte-client[82814]: System call of process 100216 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:58:51 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=139, name=volume-eb5d61db-0097-4739-a1dc-37ab04ebe373, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a98555-5205-49c9-ab83-1a21c4f301c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f77d89d8-94da-4feb-9ca4-9dddd0805f8d', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce095d6-925a-4dcf-bd64-d36497d6a51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-eb5d61db-0097-4739-a1dc-37ab04ebe373 1073741824" returned: 0 in 0.406s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:58:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-eb5d61db-0097-4739-a1dc-37ab04ebe373 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:58:52 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume volume-f77d89d8-94da-4feb-9ca4-9dddd0805f8d (f77d89d8-94da-4feb-9ca4-9dddd0805f8d): created successfully Sep 10 15:58:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce095d6-925a-4dcf-bd64-d36497d6a51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Flow 'volume_create_manager' (33e5f747-db90-4c12-9e3e-227928a317e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:58:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-eb5d61db-0097-4739-a1dc-37ab04ebe373" returned: 0 in 0.304s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:58:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] <== create_volume: return (739ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:58:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:58:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.066s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:58:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1237787936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6d77150-a642-4eaf-91b4-8fc663b467a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e1a733774e474590220160aa979506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:58:51Z,use_quota=True,user_id='6b8d452529ce4f8c8f70bbe5e4994f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:58:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Creating volume b6d77150-a642-4eaf-91b4-8fc663b467a6 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:58:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:58:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:58:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:58:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:58:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:58:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:58:52 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:58:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b6d77150-a642-4eaf-91b4-8fc663b467a6 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:58:52 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=140, name=volume-b6d77150-a642-4eaf-91b4-8fc663b467a6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:58:52 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-0c443b56-eba2-4ce8-9340-bfb6f380116d tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Created volume successfully. Sep 10 15:58:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc3ad850-cfe3-4d35-afee-e7e7280daab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb5d61db-0097-4739-a1dc-37ab04ebe373', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eddcad2-7151-4c87-a9d1-5de983a971bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:52 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume volume-eb5d61db-0097-4739-a1dc-37ab04ebe373 (eb5d61db-0097-4739-a1dc-37ab04ebe373): created successfully Sep 10 15:58:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eddcad2-7151-4c87-a9d1-5de983a971bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Flow 'volume_create_manager' (4c53c43a-9b89-44d4-9631-1e699b014faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:58:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b6d77150-a642-4eaf-91b4-8fc663b467a6 1073741824" returned: 0 in 0.444s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:58:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b6d77150-a642-4eaf-91b4-8fc663b467a6 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:58:52 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-d01848e2-58be-47b0-be85-309047c0c5a6 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Created volume successfully. Sep 10 15:58:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b6d77150-a642-4eaf-91b4-8fc663b467a6" returned: 0 in 0.254s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:58:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] <== create_volume: return (721ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:58:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:58:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.799s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:58:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1390408383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9430f7be-9272-4db8-83be-2c188eeba559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59e1a733774e474590220160aa979506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:58:50Z,use_quota=True,user_id='6b8d452529ce4f8c8f70bbe5e4994f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:58:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Creating volume 9430f7be-9272-4db8-83be-2c188eeba559 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:58:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:58:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:58:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:58:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:58:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:58:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:58:53 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:58:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9430f7be-9272-4db8-83be-2c188eeba559 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:58:53 devstack quobyte-client[82814]: System call of process 100225 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:58:53 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=141, name=volume-9430f7be-9272-4db8-83be-2c188eeba559, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:58:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d59a478f-66e2-4fcb-ae9b-533030454023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6d77150-a642-4eaf-91b4-8fc663b467a6', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21a95af-09a8-4235-ad7f-85331110bfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:53 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume volume-b6d77150-a642-4eaf-91b4-8fc663b467a6 (b6d77150-a642-4eaf-91b4-8fc663b467a6): created successfully Sep 10 15:58:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21a95af-09a8-4235-ad7f-85331110bfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Flow 'volume_create_manager' (60824d3b-c9dc-4cf6-a005-ba6bfb6826d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:58:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9430f7be-9272-4db8-83be-2c188eeba559 1073741824" returned: 0 in 0.402s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:58:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9430f7be-9272-4db8-83be-2c188eeba559 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:58:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9430f7be-9272-4db8-83be-2c188eeba559" returned: 0 in 0.136s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:58:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] <== create_volume: return (583ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:58:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.606s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:58:53 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-e4887002-8404-4fdd-8ba9-352d4baadbf5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Created volume successfully. Sep 10 15:58:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (039c0e13-2c3f-4553-b0e6-dd3a5f8c7ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9430f7be-9272-4db8-83be-2c188eeba559', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef71b1e-6ab0-4daf-89ea-c6bced512a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:58:53 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume volume-9430f7be-9272-4db8-83be-2c188eeba559 (9430f7be-9272-4db8-83be-2c188eeba559): created successfully Sep 10 15:58:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef71b1e-6ab0-4daf-89ea-c6bced512a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:58:53 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Flow 'volume_create_manager' (e37014c2-7ea3-490a-aeb5-bf9da86f5f9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:58:53 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-b419376b-e71f-49bc-876f-0ac2058fc2b0 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Created volume successfully. Sep 10 15:58:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-6a4ddec7-c04d-4da5-bd11-e16b6f514a45 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "cinder-b6d77150-a642-4eaf-91b4-8fc663b467a6-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:58:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-6a4ddec7-c04d-4da5-bd11-e16b6f514a45 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "cinder-b6d77150-a642-4eaf-91b4-8fc663b467a6-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:58:54 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-6a4ddec7-c04d-4da5-bd11-e16b6f514a45 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:58:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-6a4ddec7-c04d-4da5-bd11-e16b6f514a45 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "cinder-quobyte-b6d77150-a642-4eaf-91b4-8fc663b467a6" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:58:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-6a4ddec7-c04d-4da5-bd11-e16b6f514a45 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "cinder-quobyte-b6d77150-a642-4eaf-91b4-8fc663b467a6" acquired by "delete_volume" :: waited 0.013s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:58:54 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf4c3b3-fb88-482f-aafd-f831927fced3]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:58:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6a4ddec7-c04d-4da5-bd11-e16b6f514a45 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b6d77150-a642-4eaf-91b4-8fc663b467a6 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:58:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6a4ddec7-c04d-4da5-bd11-e16b6f514a45 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b6d77150-a642-4eaf-91b4-8fc663b467a6" returned: 0 in 0.416s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:58:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6a4ddec7-c04d-4da5-bd11-e16b6f514a45 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b6d77150-a642-4eaf-91b4-8fc663b467a6 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:58:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6a4ddec7-c04d-4da5-bd11-e16b6f514a45 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-b6d77150-a642-4eaf-91b4-8fc663b467a6" returned: 0 in 0.085s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:58:55 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-6a4ddec7-c04d-4da5-bd11-e16b6f514a45 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "cinder-quobyte-b6d77150-a642-4eaf-91b4-8fc663b467a6" released by "delete_volume" :: held 0.648s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:58:55 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-6a4ddec7-c04d-4da5-bd11-e16b6f514a45 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Created reservations ['3919d08e-59bd-42d8-abff-1e8473fb886d', '5ef26f75-58a8-4d84-b3fb-d3978c6304a9', '605307d3-8936-4cf3-b204-d8d93d6df1d8', 'bc8e1bba-76c5-4159-bc9a-30c0a41a34bc'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:58:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6a4ddec7-c04d-4da5-bd11-e16b6f514a45 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:58:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6a4ddec7-c04d-4da5-bd11-e16b6f514a45 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:58:55 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6a4ddec7-c04d-4da5-bd11-e16b6f514a45 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:58:55 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6a4ddec7-c04d-4da5-bd11-e16b6f514a45 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:58:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6a4ddec7-c04d-4da5-bd11-e16b6f514a45 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:58:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6a4ddec7-c04d-4da5-bd11-e16b6f514a45 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:58:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6a4ddec7-c04d-4da5-bd11-e16b6f514a45 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.090s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:58:55 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-6a4ddec7-c04d-4da5-bd11-e16b6f514a45 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:58:55 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-6a4ddec7-c04d-4da5-bd11-e16b6f514a45 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Deleted volume successfully. Sep 10 15:58:56 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-6a4ddec7-c04d-4da5-bd11-e16b6f514a45 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "cinder-b6d77150-a642-4eaf-91b4-8fc663b467a6-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:58:56 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-dc91b3a9-35dc-4757-852a-755dfb7be8b5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "cinder-eb5d61db-0097-4739-a1dc-37ab04ebe373-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:58:56 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-dc91b3a9-35dc-4757-852a-755dfb7be8b5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "cinder-eb5d61db-0097-4739-a1dc-37ab04ebe373-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:58:56 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-dc91b3a9-35dc-4757-852a-755dfb7be8b5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:58:56 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-dc91b3a9-35dc-4757-852a-755dfb7be8b5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "cinder-quobyte-eb5d61db-0097-4739-a1dc-37ab04ebe373" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:58:56 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-dc91b3a9-35dc-4757-852a-755dfb7be8b5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "cinder-quobyte-eb5d61db-0097-4739-a1dc-37ab04ebe373" acquired by "delete_volume" :: waited 0.016s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:58:56 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[127d9688-93b4-4546-98c6-026c94ab2337]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:58:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-dc91b3a9-35dc-4757-852a-755dfb7be8b5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-eb5d61db-0097-4739-a1dc-37ab04ebe373 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:58:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-dc91b3a9-35dc-4757-852a-755dfb7be8b5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-eb5d61db-0097-4739-a1dc-37ab04ebe373" returned: 0 in 0.512s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:58:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-dc91b3a9-35dc-4757-852a-755dfb7be8b5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-eb5d61db-0097-4739-a1dc-37ab04ebe373 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:58:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-dc91b3a9-35dc-4757-852a-755dfb7be8b5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-eb5d61db-0097-4739-a1dc-37ab04ebe373" returned: 0 in 0.126s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:58:57 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-dc91b3a9-35dc-4757-852a-755dfb7be8b5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "cinder-quobyte-eb5d61db-0097-4739-a1dc-37ab04ebe373" released by "delete_volume" :: held 0.807s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:58:57 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-dc91b3a9-35dc-4757-852a-755dfb7be8b5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Created reservations ['50db54b7-24a2-4007-a563-ed9b35ef0c90', 'b9697ec3-75d4-487c-9b91-8d876a4c03c4', '11526538-2768-49bb-9d1c-de51c417d1dd', '60664da3-a85e-45cd-bac6-ddb81d3e99b7'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:58:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-dc91b3a9-35dc-4757-852a-755dfb7be8b5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:58:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-dc91b3a9-35dc-4757-852a-755dfb7be8b5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:58:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-dc91b3a9-35dc-4757-852a-755dfb7be8b5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:58:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-dc91b3a9-35dc-4757-852a-755dfb7be8b5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:58:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-dc91b3a9-35dc-4757-852a-755dfb7be8b5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:58:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-dc91b3a9-35dc-4757-852a-755dfb7be8b5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:58:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-dc91b3a9-35dc-4757-852a-755dfb7be8b5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.274s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:58:58 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-dc91b3a9-35dc-4757-852a-755dfb7be8b5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:58:58 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-dc91b3a9-35dc-4757-852a-755dfb7be8b5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Deleted volume successfully. Sep 10 15:58:58 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-dc91b3a9-35dc-4757-852a-755dfb7be8b5 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "cinder-eb5d61db-0097-4739-a1dc-37ab04ebe373-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:58:58 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-8e8d40a2-15bf-4c6b-b983-7e5557d31795 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "cinder-9430f7be-9272-4db8-83be-2c188eeba559-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:58:58 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-8e8d40a2-15bf-4c6b-b983-7e5557d31795 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "cinder-9430f7be-9272-4db8-83be-2c188eeba559-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:58:59 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-8e8d40a2-15bf-4c6b-b983-7e5557d31795 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:58:59 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-8e8d40a2-15bf-4c6b-b983-7e5557d31795 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "cinder-quobyte-9430f7be-9272-4db8-83be-2c188eeba559" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:58:59 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-8e8d40a2-15bf-4c6b-b983-7e5557d31795 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "cinder-quobyte-9430f7be-9272-4db8-83be-2c188eeba559" acquired by "delete_volume" :: waited 0.012s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:58:59 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c32f22-3e6c-4eef-9f5c-6e85fc11ae64]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:58:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8e8d40a2-15bf-4c6b-b983-7e5557d31795 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9430f7be-9272-4db8-83be-2c188eeba559 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:58:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8e8d40a2-15bf-4c6b-b983-7e5557d31795 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9430f7be-9272-4db8-83be-2c188eeba559" returned: 0 in 0.395s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:58:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8e8d40a2-15bf-4c6b-b983-7e5557d31795 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9430f7be-9272-4db8-83be-2c188eeba559 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:58:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8e8d40a2-15bf-4c6b-b983-7e5557d31795 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-9430f7be-9272-4db8-83be-2c188eeba559" returned: 0 in 0.108s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:58:59 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-8e8d40a2-15bf-4c6b-b983-7e5557d31795 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "cinder-quobyte-9430f7be-9272-4db8-83be-2c188eeba559" released by "delete_volume" :: held 0.639s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:58:59 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-8e8d40a2-15bf-4c6b-b983-7e5557d31795 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Created reservations ['69ff89ad-5063-48a5-983b-601babf5926e', '4f1ccb7d-a42e-42f9-951d-1837d05d4cf7', '0f5159c3-0499-4962-8247-bd92312282d0', '35459d8e-59e1-4e32-9626-b0341227571b'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:59:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8e8d40a2-15bf-4c6b-b983-7e5557d31795 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:59:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8e8d40a2-15bf-4c6b-b983-7e5557d31795 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:59:00 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8e8d40a2-15bf-4c6b-b983-7e5557d31795 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:59:00 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-8e8d40a2-15bf-4c6b-b983-7e5557d31795 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:59:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-8e8d40a2-15bf-4c6b-b983-7e5557d31795 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:59:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8e8d40a2-15bf-4c6b-b983-7e5557d31795 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-8e8d40a2-15bf-4c6b-b983-7e5557d31795 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.100s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:00 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-8e8d40a2-15bf-4c6b-b983-7e5557d31795 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:59:00 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-8e8d40a2-15bf-4c6b-b983-7e5557d31795 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Deleted volume successfully. Sep 10 15:59:00 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-8e8d40a2-15bf-4c6b-b983-7e5557d31795 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "cinder-9430f7be-9272-4db8-83be-2c188eeba559-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:59:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-378a6790-5c01-46fb-af82-96d52b0201ee tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "cinder-f77d89d8-94da-4feb-9ca4-9dddd0805f8d-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:59:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-378a6790-5c01-46fb-af82-96d52b0201ee tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "cinder-f77d89d8-94da-4feb-9ca4-9dddd0805f8d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:59:01 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-378a6790-5c01-46fb-af82-96d52b0201ee tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:59:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-378a6790-5c01-46fb-af82-96d52b0201ee tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "cinder-quobyte-f77d89d8-94da-4feb-9ca4-9dddd0805f8d" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:59:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-378a6790-5c01-46fb-af82-96d52b0201ee tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "cinder-quobyte-f77d89d8-94da-4feb-9ca4-9dddd0805f8d" acquired by "delete_volume" :: waited 0.015s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:59:01 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[183b2490-c6e5-4fca-8c4d-2142f6c615f6]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:59:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-378a6790-5c01-46fb-af82-96d52b0201ee tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f77d89d8-94da-4feb-9ca4-9dddd0805f8d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-378a6790-5c01-46fb-af82-96d52b0201ee tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f77d89d8-94da-4feb-9ca4-9dddd0805f8d" returned: 0 in 0.380s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-378a6790-5c01-46fb-af82-96d52b0201ee tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f77d89d8-94da-4feb-9ca4-9dddd0805f8d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-378a6790-5c01-46fb-af82-96d52b0201ee tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f77d89d8-94da-4feb-9ca4-9dddd0805f8d" returned: 0 in 0.111s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:02 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-378a6790-5c01-46fb-af82-96d52b0201ee tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "cinder-quobyte-f77d89d8-94da-4feb-9ca4-9dddd0805f8d" released by "delete_volume" :: held 0.624s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:59:02 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-378a6790-5c01-46fb-af82-96d52b0201ee tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Created reservations ['e17b5229-1fd4-4623-bff8-dbad59619ed1', '176be664-d49b-4e4f-ab25-fe79944891eb', 'c0521bbd-d7c0-4a0d-9d86-c8ce179769f2', '406a97d6-550c-4c89-a6e3-c055b3ffde1c'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:59:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-378a6790-5c01-46fb-af82-96d52b0201ee tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:59:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-378a6790-5c01-46fb-af82-96d52b0201ee tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:59:02 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-378a6790-5c01-46fb-af82-96d52b0201ee tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:59:02 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-378a6790-5c01-46fb-af82-96d52b0201ee tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:59:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-378a6790-5c01-46fb-af82-96d52b0201ee tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:59:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-378a6790-5c01-46fb-af82-96d52b0201ee tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-378a6790-5c01-46fb-af82-96d52b0201ee tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.111s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:02 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-378a6790-5c01-46fb-af82-96d52b0201ee tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:59:02 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-378a6790-5c01-46fb-af82-96d52b0201ee tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Deleted volume successfully. Sep 10 15:59:02 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-378a6790-5c01-46fb-af82-96d52b0201ee tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "cinder-f77d89d8-94da-4feb-9ca4-9dddd0805f8d-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:59:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-3c3c7b07-af38-41b1-a99e-10785e4e6fbc tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "cinder-ccaa444c-811c-4135-8fe7-5998c74863b5-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:59:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-3c3c7b07-af38-41b1-a99e-10785e4e6fbc tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "cinder-ccaa444c-811c-4135-8fe7-5998c74863b5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:59:03 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-3c3c7b07-af38-41b1-a99e-10785e4e6fbc tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:59:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-3c3c7b07-af38-41b1-a99e-10785e4e6fbc tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "cinder-quobyte-ccaa444c-811c-4135-8fe7-5998c74863b5" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:59:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-3c3c7b07-af38-41b1-a99e-10785e4e6fbc tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "cinder-quobyte-ccaa444c-811c-4135-8fe7-5998c74863b5" acquired by "delete_volume" :: waited 0.011s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:59:03 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[0931a4d8-f2c3-4050-8356-68fcaaac66f8]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:59:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3c3c7b07-af38-41b1-a99e-10785e4e6fbc tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ccaa444c-811c-4135-8fe7-5998c74863b5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3c3c7b07-af38-41b1-a99e-10785e4e6fbc tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ccaa444c-811c-4135-8fe7-5998c74863b5" returned: 0 in 0.385s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3c3c7b07-af38-41b1-a99e-10785e4e6fbc tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ccaa444c-811c-4135-8fe7-5998c74863b5 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3c3c7b07-af38-41b1-a99e-10785e4e6fbc tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ccaa444c-811c-4135-8fe7-5998c74863b5" returned: 0 in 0.102s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:04 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-3c3c7b07-af38-41b1-a99e-10785e4e6fbc tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "cinder-quobyte-ccaa444c-811c-4135-8fe7-5998c74863b5" released by "delete_volume" :: held 0.619s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:59:04 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-3c3c7b07-af38-41b1-a99e-10785e4e6fbc tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Created reservations ['50af8233-3f14-4429-b001-495ea9ed5cf2', '04cd2971-6998-40ce-96aa-5d39bb70848b', '9da1cd4d-befd-4050-87fb-d5da539719b3', '37fc30c1-eeaf-4843-be2f-0c6502dbd6c4'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:59:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-3c3c7b07-af38-41b1-a99e-10785e4e6fbc tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:59:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-3c3c7b07-af38-41b1-a99e-10785e4e6fbc tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:59:04 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-3c3c7b07-af38-41b1-a99e-10785e4e6fbc tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:59:04 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-3c3c7b07-af38-41b1-a99e-10785e4e6fbc tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:59:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-3c3c7b07-af38-41b1-a99e-10785e4e6fbc tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:59:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3c3c7b07-af38-41b1-a99e-10785e4e6fbc tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:04 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-bf38f42d-1a99-432c-acc6-b9615bafb578 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "cinder-84472748-f195-4c80-8336-0c1b83739f31-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:59:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3c3c7b07-af38-41b1-a99e-10785e4e6fbc tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.266s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:04 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-3c3c7b07-af38-41b1-a99e-10785e4e6fbc tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:59:04 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-3c3c7b07-af38-41b1-a99e-10785e4e6fbc tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Deleted volume successfully. Sep 10 15:59:05 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-bf38f42d-1a99-432c-acc6-b9615bafb578 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "cinder-84472748-f195-4c80-8336-0c1b83739f31-delete_volume" acquired by "delete_volume" :: waited 0.207s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:59:05 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-3c3c7b07-af38-41b1-a99e-10785e4e6fbc tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "cinder-ccaa444c-811c-4135-8fe7-5998c74863b5-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:59:05 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-bf38f42d-1a99-432c-acc6-b9615bafb578 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:59:05 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-bf38f42d-1a99-432c-acc6-b9615bafb578 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "cinder-quobyte-84472748-f195-4c80-8336-0c1b83739f31" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:59:05 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-bf38f42d-1a99-432c-acc6-b9615bafb578 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "cinder-quobyte-84472748-f195-4c80-8336-0c1b83739f31" acquired by "delete_volume" :: waited 0.011s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:59:05 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf6faf1-f52b-460c-8ab7-4b0e4d92f109]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:59:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bf38f42d-1a99-432c-acc6-b9615bafb578 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-84472748-f195-4c80-8336-0c1b83739f31 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bf38f42d-1a99-432c-acc6-b9615bafb578 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-84472748-f195-4c80-8336-0c1b83739f31" returned: 0 in 0.381s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bf38f42d-1a99-432c-acc6-b9615bafb578 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-84472748-f195-4c80-8336-0c1b83739f31 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bf38f42d-1a99-432c-acc6-b9615bafb578 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-84472748-f195-4c80-8336-0c1b83739f31" returned: 0 in 0.090s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:05 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-bf38f42d-1a99-432c-acc6-b9615bafb578 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "cinder-quobyte-84472748-f195-4c80-8336-0c1b83739f31" released by "delete_volume" :: held 0.636s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:59:06 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-bf38f42d-1a99-432c-acc6-b9615bafb578 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Created reservations ['3908e04a-30ef-45ce-866b-6715187fdf4b', '3b92c3ad-e4ce-450c-88ff-643b05642bea', '437aa057-bed9-4b81-8089-ab7e0d962086', '6b5c5ffc-b40b-458f-9893-1dd4108cad2d'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:59:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-bf38f42d-1a99-432c-acc6-b9615bafb578 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:59:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-bf38f42d-1a99-432c-acc6-b9615bafb578 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:59:06 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-bf38f42d-1a99-432c-acc6-b9615bafb578 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:59:06 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-bf38f42d-1a99-432c-acc6-b9615bafb578 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:59:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-bf38f42d-1a99-432c-acc6-b9615bafb578 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:59:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bf38f42d-1a99-432c-acc6-b9615bafb578 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bf38f42d-1a99-432c-acc6-b9615bafb578 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.083s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:06 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-bf38f42d-1a99-432c-acc6-b9615bafb578 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:59:06 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-bf38f42d-1a99-432c-acc6-b9615bafb578 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Deleted volume successfully. Sep 10 15:59:06 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-bf38f42d-1a99-432c-acc6-b9615bafb578 tempest-CreateVolumesFromSourceVolumeTest-1126350037 None] Lock "cinder-84472748-f195-4c80-8336-0c1b83739f31-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:59:16 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=43,cinder:UPDATE=58,cinder:DELETE=3,cinder:INSERT=13 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:59:16 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=63,cinder:DELETE=9,cinder:SELECT=30,cinder:INSERT=11 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:59:28 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:59:28 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:59:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Flow 'volume_create_manager' (81d90744-38e5-423a-9381-4f27592dddef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:59:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (630a9503-c327-43e3-9758-ad6065202c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:59:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (630a9503-c327-43e3-9758-ad6065202c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1139883757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff629a70-fe63-4d44-bd50-d554faf330b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c6b9a796df045c195cf86d717d8cb06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:59:28Z,use_quota=True,user_id='be6124289b864fb5a18e0fb353bf215d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:59:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2fef23-33fb-4e1f-93ce-f05f3c553dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:59:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2fef23-33fb-4e1f-93ce-f05f3c553dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:59:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d7620f-4458-4324-8f7f-da20bc83fa3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:59:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d7620f-4458-4324-8f7f-da20bc83fa3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff629a70-fe63-4d44-bd50-d554faf330b8', 'volume_name': 'volume-ff629a70-fe63-4d44-bd50-d554faf330b8', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:59:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1af9dbcd-bef2-439b-9d51-928e865f6364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:59:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1af9dbcd-bef2-439b-9d51-928e865f6364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:59:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c686fbfb-89e8-45cf-901b-3ee5b45a18ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:59:28 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Volume ff629a70-fe63-4d44-bd50-d554faf330b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff629a70-fe63-4d44-bd50-d554faf330b8', 'volume_size': 1} Sep 10 15:59:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:59:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:59:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1139883757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff629a70-fe63-4d44-bd50-d554faf330b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c6b9a796df045c195cf86d717d8cb06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:59:28Z,use_quota=True,user_id='be6124289b864fb5a18e0fb353bf215d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 15:59:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Creating volume ff629a70-fe63-4d44-bd50-d554faf330b8 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 15:59:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:59:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:59:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:59:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:59:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:59:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:59:28 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 15:59:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:28 devstack quobyte-client[82814]: System call of process 100303 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:59:28 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=142, name=volume-ff629a70-fe63-4d44-bd50-d554faf330b8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:59:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8 1073741824" returned: 0 in 0.324s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8" returned: 0 in 0.091s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] <== create_volume: return (485ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 15:59:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.497s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:59:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c686fbfb-89e8-45cf-901b-3ee5b45a18ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff629a70-fe63-4d44-bd50-d554faf330b8', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:59:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf0517b-994a-4944-8e87-9e799f163e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:59:29 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Volume volume-ff629a70-fe63-4d44-bd50-d554faf330b8 (ff629a70-fe63-4d44-bd50-d554faf330b8): created successfully Sep 10 15:59:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf0517b-994a-4944-8e87-9e799f163e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:59:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Flow 'volume_create_manager' (81d90744-38e5-423a-9381-4f27592dddef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:59:29 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-02c03f64-bca4-457f-891d-0dd8d48cf3ee tempest-SnapshotDependencyTests-1792669900 None] Created volume successfully. Sep 10 15:59:29 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-379e95ee-2ca9-4ac2-bc64-3aa9e0146df6 tempest-SnapshotDependencyTests-1792669900 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:59:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-379e95ee-2ca9-4ac2-bc64-3aa9e0146df6 tempest-SnapshotDependencyTests-1792669900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:59:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-379e95ee-2ca9-4ac2-bc64-3aa9e0146df6 tempest-SnapshotDependencyTests-1792669900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:59:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-379e95ee-2ca9-4ac2-bc64-3aa9e0146df6 tempest-SnapshotDependencyTests-1792669900 None] Creating offline snapshot 36f5196a-9b4c-462a-927a-5b7522f3db0f of volume ff629a70-fe63-4d44-bd50-d554faf330b8 {{(pid=82800) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 15:59:29 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[893c65cf-5603-47f3-bd14-a7ecec69f8a1]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:59:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-379e95ee-2ca9-4ac2-bc64-3aa9e0146df6 tempest-SnapshotDependencyTests-1792669900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:29 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 15:59:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:59:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:59:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:59:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:59:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:59:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.133s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:30 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:59:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-379e95ee-2ca9-4ac2-bc64-3aa9e0146df6 tempest-SnapshotDependencyTests-1792669900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8" returned: 0 in 0.511s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-379e95ee-2ca9-4ac2-bc64-3aa9e0146df6 tempest-SnapshotDependencyTests-1792669900 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8.36f5196a-9b4c-462a-927a-5b7522f3db0f 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:30 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=143, name=volume-ff629a70-fe63-4d44-bd50-d554faf330b8.36f5196a-9b4c-462a-927a-5b7522f3db0f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:59:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-379e95ee-2ca9-4ac2-bc64-3aa9e0146df6 tempest-SnapshotDependencyTests-1792669900 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8.36f5196a-9b4c-462a-927a-5b7522f3db0f 1G" returned: 0 in 0.234s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-379e95ee-2ca9-4ac2-bc64-3aa9e0146df6 tempest-SnapshotDependencyTests-1792669900 None] Running cmd (subprocess): qemu-img rebase -u -b volume-ff629a70-fe63-4d44-bd50-d554faf330b8 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8.36f5196a-9b4c-462a-927a-5b7522f3db0f {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-379e95ee-2ca9-4ac2-bc64-3aa9e0146df6 tempest-SnapshotDependencyTests-1792669900 None] CMD "qemu-img rebase -u -b volume-ff629a70-fe63-4d44-bd50-d554faf330b8 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8.36f5196a-9b4c-462a-927a-5b7522f3db0f" returned: 0 in 0.148s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-379e95ee-2ca9-4ac2-bc64-3aa9e0146df6 tempest-SnapshotDependencyTests-1792669900 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8.36f5196a-9b4c-462a-927a-5b7522f3db0f is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:59:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-379e95ee-2ca9-4ac2-bc64-3aa9e0146df6 tempest-SnapshotDependencyTests-1792669900 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8.36f5196a-9b4c-462a-927a-5b7522f3db0f {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-379e95ee-2ca9-4ac2-bc64-3aa9e0146df6 tempest-SnapshotDependencyTests-1792669900 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8.36f5196a-9b4c-462a-927a-5b7522f3db0f" returned: 0 in 0.083s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-379e95ee-2ca9-4ac2-bc64-3aa9e0146df6 tempest-SnapshotDependencyTests-1792669900 None] Setting permissions: /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8 -> 1000:1000 {{(pid=82800) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 15:59:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-379e95ee-2ca9-4ac2-bc64-3aa9e0146df6 tempest-SnapshotDependencyTests-1792669900 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8.36f5196a-9b4c-462a-927a-5b7522f3db0f {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-379e95ee-2ca9-4ac2-bc64-3aa9e0146df6 tempest-SnapshotDependencyTests-1792669900 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8.36f5196a-9b4c-462a-927a-5b7522f3db0f" returned: 0 in 0.115s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-379e95ee-2ca9-4ac2-bc64-3aa9e0146df6 tempest-SnapshotDependencyTests-1792669900 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-379e95ee-2ca9-4ac2-bc64-3aa9e0146df6 tempest-SnapshotDependencyTests-1792669900 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8.info" returned: 0 in 0.087s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:31 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-379e95ee-2ca9-4ac2-bc64-3aa9e0146df6 tempest-SnapshotDependencyTests-1792669900 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8.info is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:59:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-379e95ee-2ca9-4ac2-bc64-3aa9e0146df6 tempest-SnapshotDependencyTests-1792669900 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-379e95ee-2ca9-4ac2-bc64-3aa9e0146df6 tempest-SnapshotDependencyTests-1792669900 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8.info" returned: 0 in 0.080s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-379e95ee-2ca9-4ac2-bc64-3aa9e0146df6 tempest-SnapshotDependencyTests-1792669900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.562s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:59:31 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-379e95ee-2ca9-4ac2-bc64-3aa9e0146df6 tempest-SnapshotDependencyTests-1792669900 None] Create snapshot completed successfully Sep 10 15:59:32 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Flow 'volume_create_manager' (791de2cb-f5a4-4b4e-a628-bd60b63071d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bde236a-8e15-4109-afab-8340ce82b3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bde236a-8e15-4109-afab-8340ce82b3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T13:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc14da47-888f-4833-a65c-5ac89561a79c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c6b9a796df045c195cf86d717d8cb06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T13:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=36f5196a-9b4c-462a-927a-5b7522f3db0f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T13:59:32Z,use_quota=True,user_id='be6124289b864fb5a18e0fb353bf215d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28583a83-f708-4c67-8264-4731fa5c54e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28583a83-f708-4c67-8264-4731fa5c54e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af63606-037c-4d93-93b9-f58890a6edc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af63606-037c-4d93-93b9-f58890a6edc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cc14da47-888f-4833-a65c-5ac89561a79c', 'volume_name': 'volume-cc14da47-888f-4833-a65c-5ac89561a79c', 'volume_size': 1, 'snapshot_id': '36f5196a-9b4c-462a-927a-5b7522f3db0f'}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9bab9b-06a6-4b95-a317-99f547a295c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9bab9b-06a6-4b95-a317-99f547a295c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (912ab175-2d28-45d8-83e4-d17f2453cbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:59:32 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Volume cc14da47-888f-4833-a65c-5ac89561a79c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cc14da47-888f-4833-a65c-5ac89561a79c', 'volume_size': 1, 'snapshot_id': '36f5196a-9b4c-462a-927a-5b7522f3db0f'} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Acquiring lock "cinder-quobyte-36f5196a-9b4c-462a-927a-5b7522f3db0f-cc14da47-888f-4833-a65c-5ac89561a79c" by "_create_volume_from_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Lock "cinder-quobyte-36f5196a-9b4c-462a-927a-5b7522f3db0f-cc14da47-888f-4833-a65c-5ac89561a79c" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Creating volume cc14da47-888f-4833-a65c-5ac89561a79c from snapshot 36f5196a-9b4c-462a-927a-5b7522f3db0f {{(pid=82800) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Acquiring lock "cinder-quobyte-cc14da47-888f-4833-a65c-5ac89561a79c" by "_copy_volume_from_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Lock "cinder-quobyte-cc14da47-888f-4833-a65c-5ac89561a79c" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] snapshot: 36f5196a-9b4c-462a-927a-5b7522f3db0f, volume: cc14da47-888f-4833-a65c-5ac89561a79c, {{(pid=82800) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[f000b075-a350-4d6d-b6b7-fce8e3a4828c]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8.36f5196a-9b4c-462a-927a-5b7522f3db0f {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8.36f5196a-9b4c-462a-927a-5b7522f3db0f" returned: 0 in 0.410s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff629a70-fe63-4d44-bd50-d554faf330b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8 {{(pid=82800) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Creating direct copy from snapshot {{(pid=82800) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6514cd6-3f31-40b8-a4fc-0d407ed06c4f]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:59:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8" returned: 0 in 0.389s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:33 devstack cinder-volume[82800]: DEBUG cinder.utils [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-cc14da47-888f-4833-a65c-5ac89561a79c not found in is_blk_device check {{(pid=82800) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 10 15:59:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-cc14da47-888f-4833-a65c-5ac89561a79c {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:33 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=145, name=volume-cc14da47-888f-4833-a65c-5ac89561a79c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 15:59:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-cc14da47-888f-4833-a65c-5ac89561a79c" returned: 0 in 5.897s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:39 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb730d59-ccd2-4450-af81-72312448b6b5]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:59:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8" returned: 0 in 0.565s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:39 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Image conversion details: src /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8, size 1024.00 MB, duration 5.93 sec, destination /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-cc14da47-888f-4833-a65c-5ac89561a79c {{(pid=82800) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 15:59:39 devstack cinder-volume[82800]: INFO cinder.image.image_utils [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Converted 1024.00 MB image at 172.70 MB/s Sep 10 15:59:39 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-cc14da47-888f-4833-a65c-5ac89561a79c is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 15:59:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-cc14da47-888f-4833-a65c-5ac89561a79c {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-cc14da47-888f-4833-a65c-5ac89561a79c" returned: 0 in 0.107s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:40 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Lock "cinder-quobyte-cc14da47-888f-4833-a65c-5ac89561a79c" released by "_copy_volume_from_snapshot" :: held 7.797s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:59:40 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Lock "cinder-quobyte-36f5196a-9b4c-462a-927a-5b7522f3db0f-cc14da47-888f-4833-a65c-5ac89561a79c" released by "_create_volume_from_snapshot" :: held 7.831s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:59:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.854s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:59:40 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (912ab175-2d28-45d8-83e4-d17f2453cbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc14da47-888f-4833-a65c-5ac89561a79c', 'volume_size': 1, 'snapshot_id': '36f5196a-9b4c-462a-927a-5b7522f3db0f'}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:59:40 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe46a9f8-a6c4-4bd7-a2bb-e8cfa755330c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 15:59:40 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Volume volume-cc14da47-888f-4833-a65c-5ac89561a79c (cc14da47-888f-4833-a65c-5ac89561a79c): created successfully Sep 10 15:59:40 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe46a9f8-a6c4-4bd7-a2bb-e8cfa755330c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 15:59:40 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Flow 'volume_create_manager' (791de2cb-f5a4-4b4e-a628-bd60b63071d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 15:59:40 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-b6ca235f-24e9-44f2-90d3-9357f807a48a tempest-SnapshotDependencyTests-1792669900 None] Created volume successfully. Sep 10 15:59:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9348d128-48b0-4a31-a132-aeb753416b12 tempest-SnapshotDependencyTests-1792669900 None] Acquiring lock "cinder-36f5196a-9b4c-462a-927a-5b7522f3db0f-delete_snapshot" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:59:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9348d128-48b0-4a31-a132-aeb753416b12 tempest-SnapshotDependencyTests-1792669900 None] Lock "cinder-36f5196a-9b4c-462a-927a-5b7522f3db0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:59:41 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-9348d128-48b0-4a31-a132-aeb753416b12 tempest-SnapshotDependencyTests-1792669900 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:59:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9348d128-48b0-4a31-a132-aeb753416b12 tempest-SnapshotDependencyTests-1792669900 None] Acquiring lock "cinder-quobyte-ff629a70-fe63-4d44-bd50-d554faf330b8" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:59:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9348d128-48b0-4a31-a132-aeb753416b12 tempest-SnapshotDependencyTests-1792669900 None] Lock "cinder-quobyte-ff629a70-fe63-4d44-bd50-d554faf330b8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:59:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9348d128-48b0-4a31-a132-aeb753416b12 tempest-SnapshotDependencyTests-1792669900 None] Acquiring lock "cinder-quobyte-36f5196a-9b4c-462a-927a-5b7522f3db0f" by "_delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:59:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9348d128-48b0-4a31-a132-aeb753416b12 tempest-SnapshotDependencyTests-1792669900 None] Lock "cinder-quobyte-36f5196a-9b4c-462a-927a-5b7522f3db0f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:59:41 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-9348d128-48b0-4a31-a132-aeb753416b12 tempest-SnapshotDependencyTests-1792669900 None] Deleting offline snapshot 36f5196a-9b4c-462a-927a-5b7522f3db0f of volume ff629a70-fe63-4d44-bd50-d554faf330b8 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 15:59:41 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-9348d128-48b0-4a31-a132-aeb753416b12 tempest-SnapshotDependencyTests-1792669900 None] snapshot_file for this snap is: volume-ff629a70-fe63-4d44-bd50-d554faf330b8.36f5196a-9b4c-462a-927a-5b7522f3db0f {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 15:59:41 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c23e71a-285c-40bf-bdf4-10a515297ef1]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:59:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9348d128-48b0-4a31-a132-aeb753416b12 tempest-SnapshotDependencyTests-1792669900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8.36f5196a-9b4c-462a-927a-5b7522f3db0f {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9348d128-48b0-4a31-a132-aeb753416b12 tempest-SnapshotDependencyTests-1792669900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8.36f5196a-9b4c-462a-927a-5b7522f3db0f" returned: 0 in 0.403s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:42 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-9348d128-48b0-4a31-a132-aeb753416b12 tempest-SnapshotDependencyTests-1792669900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff629a70-fe63-4d44-bd50-d554faf330b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 15:59:42 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d3fa57-9137-4cba-b689-965930756ebb]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:59:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9348d128-48b0-4a31-a132-aeb753416b12 tempest-SnapshotDependencyTests-1792669900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9348d128-48b0-4a31-a132-aeb753416b12 tempest-SnapshotDependencyTests-1792669900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8" returned: 0 in 0.389s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9348d128-48b0-4a31-a132-aeb753416b12 tempest-SnapshotDependencyTests-1792669900 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8.36f5196a-9b4c-462a-927a-5b7522f3db0f {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:42 devstack quobyte-client[82814]: System call of process 100348 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 15:59:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9348d128-48b0-4a31-a132-aeb753416b12 tempest-SnapshotDependencyTests-1792669900 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8.36f5196a-9b4c-462a-927a-5b7522f3db0f" returned: 0 in 0.189s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9348d128-48b0-4a31-a132-aeb753416b12 tempest-SnapshotDependencyTests-1792669900 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8.36f5196a-9b4c-462a-927a-5b7522f3db0f {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9348d128-48b0-4a31-a132-aeb753416b12 tempest-SnapshotDependencyTests-1792669900 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8.36f5196a-9b4c-462a-927a-5b7522f3db0f" returned: 0 in 0.089s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:42 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9348d128-48b0-4a31-a132-aeb753416b12 tempest-SnapshotDependencyTests-1792669900 None] Lock "cinder-quobyte-36f5196a-9b4c-462a-927a-5b7522f3db0f" released by "_delete_snapshot" :: held 1.388s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:59:42 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9348d128-48b0-4a31-a132-aeb753416b12 tempest-SnapshotDependencyTests-1792669900 None] Lock "cinder-quobyte-ff629a70-fe63-4d44-bd50-d554faf330b8" released by "delete_snapshot" :: held 1.413s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:59:43 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-9348d128-48b0-4a31-a132-aeb753416b12 tempest-SnapshotDependencyTests-1792669900 None] Created reservations ['c5a5eafc-0e7a-4217-8470-41423e87ce1b', '0b12ee4b-08dc-4664-ac6d-024ac86dcba1', '7a900d3c-501c-4d1a-b7ee-90e74a2bbf68', '51ee91d0-7d3e-4a3e-adca-dd33edc1301e'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:59:43 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-9348d128-48b0-4a31-a132-aeb753416b12 tempest-SnapshotDependencyTests-1792669900 None] Delete snapshot completed successfully. Sep 10 15:59:43 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9348d128-48b0-4a31-a132-aeb753416b12 tempest-SnapshotDependencyTests-1792669900 None] Lock "cinder-36f5196a-9b4c-462a-927a-5b7522f3db0f-delete_snapshot" released by "delete_snapshot" :: held 1.885s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:59:43 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-93fc53be-c24c-4129-8ede-9e82f72516e0 tempest-SnapshotDependencyTests-1792669900 None] Acquiring lock "cinder-ff629a70-fe63-4d44-bd50-d554faf330b8-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:59:43 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-93fc53be-c24c-4129-8ede-9e82f72516e0 tempest-SnapshotDependencyTests-1792669900 None] Lock "cinder-ff629a70-fe63-4d44-bd50-d554faf330b8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:59:43 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-93fc53be-c24c-4129-8ede-9e82f72516e0 tempest-SnapshotDependencyTests-1792669900 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:59:43 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-93fc53be-c24c-4129-8ede-9e82f72516e0 tempest-SnapshotDependencyTests-1792669900 None] Acquiring lock "cinder-quobyte-ff629a70-fe63-4d44-bd50-d554faf330b8" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:59:43 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-93fc53be-c24c-4129-8ede-9e82f72516e0 tempest-SnapshotDependencyTests-1792669900 None] Lock "cinder-quobyte-ff629a70-fe63-4d44-bd50-d554faf330b8" acquired by "delete_volume" :: waited 0.019s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:59:43 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c016dcb-126d-458c-a90d-923a0d17e1f7]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:59:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-93fc53be-c24c-4129-8ede-9e82f72516e0 tempest-SnapshotDependencyTests-1792669900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-93fc53be-c24c-4129-8ede-9e82f72516e0 tempest-SnapshotDependencyTests-1792669900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8" returned: 0 in 0.432s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-93fc53be-c24c-4129-8ede-9e82f72516e0 tempest-SnapshotDependencyTests-1792669900 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-93fc53be-c24c-4129-8ede-9e82f72516e0 tempest-SnapshotDependencyTests-1792669900 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-ff629a70-fe63-4d44-bd50-d554faf330b8" returned: 0 in 0.118s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:44 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-93fc53be-c24c-4129-8ede-9e82f72516e0 tempest-SnapshotDependencyTests-1792669900 None] Lock "cinder-quobyte-ff629a70-fe63-4d44-bd50-d554faf330b8" released by "delete_volume" :: held 0.727s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:59:44 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-93fc53be-c24c-4129-8ede-9e82f72516e0 tempest-SnapshotDependencyTests-1792669900 None] Created reservations ['763ac906-9b37-4947-88eb-87f609885a36', '9feba4c2-2011-4dfb-9ace-cb8882003f1e', '4197d6f4-652a-4b9f-b7e5-71b2ed0b1609', '38f572b7-ad6b-4644-8ff4-9c9a4e4e9ac4'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:59:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-93fc53be-c24c-4129-8ede-9e82f72516e0 tempest-SnapshotDependencyTests-1792669900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:59:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-93fc53be-c24c-4129-8ede-9e82f72516e0 tempest-SnapshotDependencyTests-1792669900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:59:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-93fc53be-c24c-4129-8ede-9e82f72516e0 tempest-SnapshotDependencyTests-1792669900 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:59:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-93fc53be-c24c-4129-8ede-9e82f72516e0 tempest-SnapshotDependencyTests-1792669900 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:59:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-93fc53be-c24c-4129-8ede-9e82f72516e0 tempest-SnapshotDependencyTests-1792669900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:59:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-93fc53be-c24c-4129-8ede-9e82f72516e0 tempest-SnapshotDependencyTests-1792669900 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-93fc53be-c24c-4129-8ede-9e82f72516e0 tempest-SnapshotDependencyTests-1792669900 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.118s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:45 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-93fc53be-c24c-4129-8ede-9e82f72516e0 tempest-SnapshotDependencyTests-1792669900 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:59:45 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-93fc53be-c24c-4129-8ede-9e82f72516e0 tempest-SnapshotDependencyTests-1792669900 None] Deleted volume successfully. Sep 10 15:59:45 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-93fc53be-c24c-4129-8ede-9e82f72516e0 tempest-SnapshotDependencyTests-1792669900 None] Lock "cinder-ff629a70-fe63-4d44-bd50-d554faf330b8-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:59:46 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ab87ff6c-8fa0-4f95-85cc-8a61f0f7cc3b tempest-SnapshotDependencyTests-1792669900 None] Acquiring lock "cinder-cc14da47-888f-4833-a65c-5ac89561a79c-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:59:46 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ab87ff6c-8fa0-4f95-85cc-8a61f0f7cc3b tempest-SnapshotDependencyTests-1792669900 None] Lock "cinder-cc14da47-888f-4833-a65c-5ac89561a79c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:59:46 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-ab87ff6c-8fa0-4f95-85cc-8a61f0f7cc3b tempest-SnapshotDependencyTests-1792669900 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 15:59:46 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ab87ff6c-8fa0-4f95-85cc-8a61f0f7cc3b tempest-SnapshotDependencyTests-1792669900 None] Acquiring lock "cinder-quobyte-cc14da47-888f-4833-a65c-5ac89561a79c" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 15:59:46 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ab87ff6c-8fa0-4f95-85cc-8a61f0f7cc3b tempest-SnapshotDependencyTests-1792669900 None] Lock "cinder-quobyte-cc14da47-888f-4833-a65c-5ac89561a79c" acquired by "delete_volume" :: waited 0.011s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 15:59:46 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ea9efd-9bf0-436b-8878-4900edc5a7f7]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 15:59:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ab87ff6c-8fa0-4f95-85cc-8a61f0f7cc3b tempest-SnapshotDependencyTests-1792669900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-cc14da47-888f-4833-a65c-5ac89561a79c {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ab87ff6c-8fa0-4f95-85cc-8a61f0f7cc3b tempest-SnapshotDependencyTests-1792669900 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-cc14da47-888f-4833-a65c-5ac89561a79c" returned: 0 in 0.369s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ab87ff6c-8fa0-4f95-85cc-8a61f0f7cc3b tempest-SnapshotDependencyTests-1792669900 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-cc14da47-888f-4833-a65c-5ac89561a79c {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ab87ff6c-8fa0-4f95-85cc-8a61f0f7cc3b tempest-SnapshotDependencyTests-1792669900 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-cc14da47-888f-4833-a65c-5ac89561a79c" returned: 0 in 0.087s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:46 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ab87ff6c-8fa0-4f95-85cc-8a61f0f7cc3b tempest-SnapshotDependencyTests-1792669900 None] Lock "cinder-quobyte-cc14da47-888f-4833-a65c-5ac89561a79c" released by "delete_volume" :: held 0.621s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:59:47 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-ab87ff6c-8fa0-4f95-85cc-8a61f0f7cc3b tempest-SnapshotDependencyTests-1792669900 None] Created reservations ['e65a0ea5-c0eb-4643-af87-74f4390fc273', 'f0a08e5e-6f07-43ab-a68b-864dcd00a402', '6f91c0e6-a148-4f00-85fc-7f000c907353', 'c77737c3-542a-472a-9026-341452ae37ad'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 15:59:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ab87ff6c-8fa0-4f95-85cc-8a61f0f7cc3b tempest-SnapshotDependencyTests-1792669900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 15:59:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ab87ff6c-8fa0-4f95-85cc-8a61f0f7cc3b tempest-SnapshotDependencyTests-1792669900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 15:59:47 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-ab87ff6c-8fa0-4f95-85cc-8a61f0f7cc3b tempest-SnapshotDependencyTests-1792669900 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 15:59:47 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-ab87ff6c-8fa0-4f95-85cc-8a61f0f7cc3b tempest-SnapshotDependencyTests-1792669900 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 15:59:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ab87ff6c-8fa0-4f95-85cc-8a61f0f7cc3b tempest-SnapshotDependencyTests-1792669900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 15:59:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ab87ff6c-8fa0-4f95-85cc-8a61f0f7cc3b tempest-SnapshotDependencyTests-1792669900 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 15:59:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ab87ff6c-8fa0-4f95-85cc-8a61f0f7cc3b tempest-SnapshotDependencyTests-1792669900 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.083s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 15:59:47 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-ab87ff6c-8fa0-4f95-85cc-8a61f0f7cc3b tempest-SnapshotDependencyTests-1792669900 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 15:59:47 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-ab87ff6c-8fa0-4f95-85cc-8a61f0f7cc3b tempest-SnapshotDependencyTests-1792669900 None] Deleted volume successfully. Sep 10 15:59:47 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ab87ff6c-8fa0-4f95-85cc-8a61f0f7cc3b tempest-SnapshotDependencyTests-1792669900 None] Lock "cinder-cc14da47-888f-4833-a65c-5ac89561a79c-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 15:59:57 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=26,cinder:DELETE=2,cinder:SELECT=16,cinder:INSERT=6 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 15:59:57 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=23,cinder:UPDATE=27,cinder:DELETE=3,cinder:INSERT=6 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 16:00:21 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:00:21 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 16:00:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Flow 'volume_create_manager' (26e51500-986e-4cc0-8f8c-f3e128fbf8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:00:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489e2e19-d9b1-4687-9455-9ba87f74524b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:21 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:00:21 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 16:00:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Flow 'volume_create_manager' (f92c8398-8f1a-42d5-b136-0b0bc5b3b3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:00:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf569a0-5679-410f-b894-d2f2e139f008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf569a0-5679-410f-b894-d2f2e139f008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-66169102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1df3fe-c997-4797-a10a-9b742b6de40d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756f830313184cf3a2f6b485616af4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:00:21Z,use_quota=True,user_id='14d0eba009b34c3d98644747d200403c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b57311c-ef9f-4ba2-a299-76b1983b7945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b57311c-ef9f-4ba2-a299-76b1983b7945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a876cd-6296-4367-a7cf-74f14ce61e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a876cd-6296-4367-a7cf-74f14ce61e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a1df3fe-c997-4797-a10a-9b742b6de40d', 'volume_name': 'volume-4a1df3fe-c997-4797-a10a-9b742b6de40d', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91458319-bb95-46bf-a6ca-4991513278d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91458319-bb95-46bf-a6ca-4991513278d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:21 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bc3d52-9c6c-4447-94e5-a81cd27ec1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:21 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Volume 4a1df3fe-c997-4797-a10a-9b742b6de40d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a1df3fe-c997-4797-a10a-9b742b6de40d', 'volume_size': 1} Sep 10 16:00:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-66169102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1df3fe-c997-4797-a10a-9b742b6de40d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756f830313184cf3a2f6b485616af4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:00:21Z,use_quota=True,user_id='14d0eba009b34c3d98644747d200403c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 16:00:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Creating volume 4a1df3fe-c997-4797-a10a-9b742b6de40d {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 16:00:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:00:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:00:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 16:00:21 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 16:00:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4a1df3fe-c997-4797-a10a-9b742b6de40d 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:21 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=146, name=volume-4a1df3fe-c997-4797-a10a-9b742b6de40d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 16:00:22 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489e2e19-d9b1-4687-9455-9ba87f74524b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-241447427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8677c651-e061-4492-b65b-678c760c4e15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05c6067af3df4c9c84de093744584348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:00:21Z,use_quota=True,user_id='b0e629555bda4006996c46b105075729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:22 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f003925-ec2d-4469-a3e8-3d7b856fa7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:22 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f003925-ec2d-4469-a3e8-3d7b856fa7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:22 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1abcd9ee-2b40-4e21-be6a-afff68d8c411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:22 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1abcd9ee-2b40-4e21-be6a-afff68d8c411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8677c651-e061-4492-b65b-678c760c4e15', 'volume_name': 'volume-8677c651-e061-4492-b65b-678c760c4e15', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:22 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b15a9fb-6ebc-4cde-8274-6a3156a5c456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:22 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b15a9fb-6ebc-4cde-8274-6a3156a5c456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:22 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (791b2e03-39e4-45fb-a0f4-a9d1140777df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:22 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume 8677c651-e061-4492-b65b-678c760c4e15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8677c651-e061-4492-b65b-678c760c4e15', 'volume_size': 1} Sep 10 16:00:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4a1df3fe-c997-4797-a10a-9b742b6de40d 1073741824" returned: 0 in 1.016s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4a1df3fe-c997-4797-a10a-9b742b6de40d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:22 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:00:22 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Flow 'volume_create_manager' (fab7161c-43ef-4c1d-b9e6-50e0fd089f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df7e46f5-b2ce-4832-82e6-d18c01fbff1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df7e46f5-b2ce-4832-82e6-d18c01fbff1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1680990416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b7fad86-5260-4a20-abf1-984fa4659eb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756f830313184cf3a2f6b485616af4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:00:23Z,use_quota=True,user_id='14d0eba009b34c3d98644747d200403c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d34373-4b24-4eab-8ab6-fe2b1169626b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d34373-4b24-4eab-8ab6-fe2b1169626b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82128f96-0b1e-4fb5-8fdc-a5e499a72de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82128f96-0b1e-4fb5-8fdc-a5e499a72de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b7fad86-5260-4a20-abf1-984fa4659eb8', 'volume_name': 'volume-4b7fad86-5260-4a20-abf1-984fa4659eb8', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3de06f-6768-4e0c-bc09-3ba385d786b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3de06f-6768-4e0c-bc09-3ba385d786b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d53b67-bee1-431b-b5cd-1a1fe605657d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:23 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Volume 4b7fad86-5260-4a20-abf1-984fa4659eb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b7fad86-5260-4a20-abf1-984fa4659eb8', 'volume_size': 1} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:23 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Flow 'volume_create_manager' (762a60da-1fc8-45da-a335-e34521dd28c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5500cc89-f26c-4a0f-8c4b-e4c16097adac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4a1df3fe-c997-4797-a10a-9b742b6de40d" returned: 0 in 0.769s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] <== create_volume: return (1847ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.076s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-241447427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8677c651-e061-4492-b65b-678c760c4e15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05c6067af3df4c9c84de093744584348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:00:21Z,use_quota=True,user_id='b0e629555bda4006996c46b105075729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Creating volume 8677c651-e061-4492-b65b-678c760c4e15 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 16:00:23 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8677c651-e061-4492-b65b-678c760c4e15 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:23 devstack quobyte-client[82814]: System call of process 100464 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 16:00:23 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=147, name=volume-8677c651-e061-4492-b65b-678c760c4e15, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5500cc89-f26c-4a0f-8c4b-e4c16097adac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-828628815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcac9bf0-9174-46e2-8935-c63679e432df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756f830313184cf3a2f6b485616af4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:00:22Z,use_quota=True,user_id='14d0eba009b34c3d98644747d200403c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea357c57-c71f-4b8e-b7e3-796ab561808a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea357c57-c71f-4b8e-b7e3-796ab561808a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e3faaf-8b7b-4bd4-9a94-b78d70397dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e3faaf-8b7b-4bd4-9a94-b78d70397dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcac9bf0-9174-46e2-8935-c63679e432df', 'volume_name': 'volume-bcac9bf0-9174-46e2-8935-c63679e432df', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a798dc10-1513-4af8-a605-8eac0a1b4964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a798dc10-1513-4af8-a605-8eac0a1b4964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d61330-3add-4843-b35e-a73083705c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:23 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Volume bcac9bf0-9174-46e2-8935-c63679e432df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcac9bf0-9174-46e2-8935-c63679e432df', 'volume_size': 1} Sep 10 16:00:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:24 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Flow 'volume_create_manager' (f9cab2c7-cbeb-4c84-9bae-44d00b36c71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee40692-d643-49fe-9640-ee43a6e5d66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9bc3d52-9c6c-4447-94e5-a81cd27ec1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a1df3fe-c997-4797-a10a-9b742b6de40d', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ebb9a17-8155-4e98-bcad-d76717b3815c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee40692-d643-49fe-9640-ee43a6e5d66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1356937105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37b00126-3368-47e7-b85d-933545d06dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756f830313184cf3a2f6b485616af4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:00:23Z,use_quota=True,user_id='14d0eba009b34c3d98644747d200403c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (670645c6-a7da-4779-9d54-4582812de4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (670645c6-a7da-4779-9d54-4582812de4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85a8a4c5-9565-45d0-b3f6-29aad86bfec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85a8a4c5-9565-45d0-b3f6-29aad86bfec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37b00126-3368-47e7-b85d-933545d06dc1', 'volume_name': 'volume-37b00126-3368-47e7-b85d-933545d06dc1', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c449aea-dabb-4309-8f51-52000e69a0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c449aea-dabb-4309-8f51-52000e69a0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1017dd84-6c8a-432b-bbd0-53feb15de3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:24 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Volume 37b00126-3368-47e7-b85d-933545d06dc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37b00126-3368-47e7-b85d-933545d06dc1', 'volume_size': 1} Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:24 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Flow 'volume_create_manager' (80ef63cf-43f1-47b9-aedc-ab73911113cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adfe0de8-aabc-4946-aa6e-f049279459db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:24 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Volume volume-4a1df3fe-c997-4797-a10a-9b742b6de40d (4a1df3fe-c997-4797-a10a-9b742b6de40d): created successfully Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ebb9a17-8155-4e98-bcad-d76717b3815c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Flow 'volume_create_manager' (f92c8398-8f1a-42d5-b136-0b0bc5b3b3e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8677c651-e061-4492-b65b-678c760c4e15 1073741824" returned: 0 in 1.005s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8677c651-e061-4492-b65b-678c760c4e15 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:24 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-3ba3ce5a-b1b3-474a-96ba-816c1c77af91 tempest-CreateVolumesFromImageTest-1949445792 None] Created volume successfully. Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adfe0de8-aabc-4946-aa6e-f049279459db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-635819341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=708d96e5-cd11-446c-bfb9-d1f2ab0830dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756f830313184cf3a2f6b485616af4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:00:24Z,use_quota=True,user_id='14d0eba009b34c3d98644747d200403c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a2ca40b-7800-494e-a99f-6d5e3e5fd128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a2ca40b-7800-494e-a99f-6d5e3e5fd128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ddb1d64-9007-4466-befc-3a119a1eb32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ddb1d64-9007-4466-befc-3a119a1eb32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '708d96e5-cd11-446c-bfb9-d1f2ab0830dd', 'volume_name': 'volume-708d96e5-cd11-446c-bfb9-d1f2ab0830dd', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23580c62-b4ee-4d85-ad96-ee9d00fe0130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23580c62-b4ee-4d85-ad96-ee9d00fe0130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d66fd13-9184-4637-aa9b-a9b9cc56bbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:24 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Volume 708d96e5-cd11-446c-bfb9-d1f2ab0830dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-708d96e5-cd11-446c-bfb9-d1f2ab0830dd', 'volume_size': 1} Sep 10 16:00:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8677c651-e061-4492-b65b-678c760c4e15" returned: 0 in 0.533s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] <== create_volume: return (1558ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 16:00:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.723s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1680990416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b7fad86-5260-4a20-abf1-984fa4659eb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756f830313184cf3a2f6b485616af4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:00:23Z,use_quota=True,user_id='14d0eba009b34c3d98644747d200403c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 16:00:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Creating volume 4b7fad86-5260-4a20-abf1-984fa4659eb8 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 16:00:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:00:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:00:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:25 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 16:00:25 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 16:00:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b7fad86-5260-4a20-abf1-984fa4659eb8 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:25 devstack quobyte-client[82814]: System call of process 100469 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 16:00:25 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=148, name=volume-4b7fad86-5260-4a20-abf1-984fa4659eb8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 16:00:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (791b2e03-39e4-45fb-a0f4-a9d1140777df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8677c651-e061-4492-b65b-678c760c4e15', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa804c0-3bce-4412-bab0-acd0fde8bd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:25 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:00:25 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 16:00:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Flow 'volume_create_manager' (f4a0f91d-483c-4b1a-ae91-44c4f816a231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:00:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72101e45-72c0-437f-acba-e2348990e55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:25 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume volume-8677c651-e061-4492-b65b-678c760c4e15 (8677c651-e061-4492-b65b-678c760c4e15): created successfully Sep 10 16:00:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa804c0-3bce-4412-bab0-acd0fde8bd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Flow 'volume_create_manager' (26e51500-986e-4cc0-8f8c-f3e128fbf8dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:00:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72101e45-72c0-437f-acba-e2348990e55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07cd259f-5d33-4958-b680-395cc0827456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939da4efd2744decaeed6fe0d480528e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:00:25Z,use_quota=True,user_id='4090827ce6b943f0b610d4c586e4a896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd36026-1594-479c-81f2-6cd32805c615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cd36026-1594-479c-81f2-6cd32805c615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:25 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0335ad35-4b13-404a-99ff-44d78982ba32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b7fad86-5260-4a20-abf1-984fa4659eb8 1073741824" returned: 0 in 0.848s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b7fad86-5260-4a20-abf1-984fa4659eb8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:26 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-d4fda822-f621-40e3-af77-ff3c0c552f4a tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Created volume successfully. Sep 10 16:00:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b7fad86-5260-4a20-abf1-984fa4659eb8" returned: 0 in 0.501s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] <== create_volume: return (1374ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 16:00:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.587s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-828628815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcac9bf0-9174-46e2-8935-c63679e432df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756f830313184cf3a2f6b485616af4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:00:22Z,use_quota=True,user_id='14d0eba009b34c3d98644747d200403c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 16:00:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Creating volume bcac9bf0-9174-46e2-8935-c63679e432df {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 16:00:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:00:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:00:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 16:00:26 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 16:00:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bcac9bf0-9174-46e2-8935-c63679e432df 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:26 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=149, name=volume-bcac9bf0-9174-46e2-8935-c63679e432df, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 16:00:27 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d53b67-bee1-431b-b5cd-1a1fe605657d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b7fad86-5260-4a20-abf1-984fa4659eb8', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:27 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a941632-b228-4077-8f84-bf02ab3c0735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:27 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0335ad35-4b13-404a-99ff-44d78982ba32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '07cd259f-5d33-4958-b680-395cc0827456', 'volume_name': 'volume-07cd259f-5d33-4958-b680-395cc0827456', 'volume_size': 1, 'image_id': '110f2ac1-722d-46c1-8c2c-8693c85b7bcd', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c23d46d8e9e6facab6a0b9df21e8b34d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '939da4efd2744decaeed6fe0d480528e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ece723021aff7d3692924bdf2c9aa0fca23e12d523f4b9d58f055c576def593d68b83df3ff184d7a46ff860d856a6adfb1eea9d503afd2917dcdc94d9bf3bae8', 'id': '110f2ac1-722d-46c1-8c2c-8693c85b7bcd', 'created_at': datetime.datetime(2025, 9, 10, 14, 0, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 14, 0, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/110f2ac1-722d-46c1-8c2c-8693c85b7bcd/file', 'properties': {}}, 'image_service': }' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:27 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a0772a-60c0-413b-a36e-9572d7b15be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:27 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a0772a-60c0-413b-a36e-9572d7b15be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:27 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc6970a5-4ed5-46b1-98f9-e5125289af96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:27 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Volume 07cd259f-5d33-4958-b680-395cc0827456: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-07cd259f-5d33-4958-b680-395cc0827456', 'volume_size': 1, 'image_id': '110f2ac1-722d-46c1-8c2c-8693c85b7bcd', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c23d46d8e9e6facab6a0b9df21e8b34d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '939da4efd2744decaeed6fe0d480528e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ece723021aff7d3692924bdf2c9aa0fca23e12d523f4b9d58f055c576def593d68b83df3ff184d7a46ff860d856a6adfb1eea9d503afd2917dcdc94d9bf3bae8', 'id': '110f2ac1-722d-46c1-8c2c-8693c85b7bcd', 'created_at': datetime.datetime(2025, 9, 10, 14, 0, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 14, 0, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/110f2ac1-722d-46c1-8c2c-8693c85b7bcd/file', 'properties': {}}, 'image_service': } Sep 10 16:00:27 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Cloning 07cd259f-5d33-4958-b680-395cc0827456 from image 110f2ac1-722d-46c1-8c2c-8693c85b7bcd at location (None, None). {{(pid=82800) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1083}} Sep 10 16:00:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bcac9bf0-9174-46e2-8935-c63679e432df 1073741824" returned: 0 in 0.689s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bcac9bf0-9174-46e2-8935-c63679e432df {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:27 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Volume volume-4b7fad86-5260-4a20-abf1-984fa4659eb8 (4b7fad86-5260-4a20-abf1-984fa4659eb8): created successfully Sep 10 16:00:27 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a941632-b228-4077-8f84-bf02ab3c0735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:27 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Flow 'volume_create_manager' (fab7161c-43ef-4c1d-b9e6-50e0fd089f08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:00:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bcac9bf0-9174-46e2-8935-c63679e432df" returned: 0 in 0.494s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:27 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] <== create_volume: return (1212ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 16:00:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.305s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:27 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1356937105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37b00126-3368-47e7-b85d-933545d06dc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756f830313184cf3a2f6b485616af4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:00:23Z,use_quota=True,user_id='14d0eba009b34c3d98644747d200403c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 16:00:27 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Creating volume 37b00126-3368-47e7-b85d-933545d06dc1 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 16:00:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:27 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:00:27 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:00:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:27 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 16:00:27 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 16:00:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-37b00126-3368-47e7-b85d-933545d06dc1 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:28 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=150, name=volume-37b00126-3368-47e7-b85d-933545d06dc1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 16:00:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4d61330-3add-4843-b35e-a73083705c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcac9bf0-9174-46e2-8935-c63679e432df', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef8654b1-216a-4108-a900-880d70f1ff7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:28 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-f664b05e-44d0-427a-a491-4410c5166f12 tempest-CreateVolumesFromImageTest-1949445792 None] Created volume successfully. Sep 10 16:00:28 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_wl7wgcxwdevstack@QuobyteHD, size 0.00 MB, duration 1.38 sec {{(pid=82800) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 10 16:00:28 devstack cinder-volume[82800]: INFO cinder.image.image_utils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Image download 0.00 MB at 0.00 MB/s Sep 10 16:00:28 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Volume volume-bcac9bf0-9174-46e2-8935-c63679e432df (bcac9bf0-9174-46e2-8935-c63679e432df): created successfully Sep 10 16:00:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef8654b1-216a-4108-a900-880d70f1ff7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Flow 'volume_create_manager' (762a60da-1fc8-45da-a335-e34521dd28c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:00:28 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:00:28 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 16:00:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Flow 'volume_create_manager' (a29b14df-91fd-4042-b999-1a11baf5b874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:00:28 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (075ce24e-5b9f-46e7-b9cc-382c11075661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-37b00126-3368-47e7-b85d-933545d06dc1 1073741824" returned: 0 in 1.063s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-37b00126-3368-47e7-b85d-933545d06dc1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:29 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-cb13da42-f1a3-4bd4-ae58-0b0fd2bd6164 tempest-CreateVolumesFromImageTest-1949445792 None] Created volume successfully. Sep 10 16:00:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (075ce24e-5b9f-46e7-b9cc-382c11075661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-304844276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39091d63-8e0e-4c1e-af1a-9849f4643111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05c6067af3df4c9c84de093744584348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:00:28Z,use_quota=True,user_id='b0e629555bda4006996c46b105075729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15b428d-395b-4c57-8244-0395d0f1d35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15b428d-395b-4c57-8244-0395d0f1d35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9fcb03-d40a-4a3e-9868-73acf965419f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9fcb03-d40a-4a3e-9868-73acf965419f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39091d63-8e0e-4c1e-af1a-9849f4643111', 'volume_name': 'volume-39091d63-8e0e-4c1e-af1a-9849f4643111', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0147ab2-afd6-4407-9a91-b29fc48240cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0147ab2-afd6-4407-9a91-b29fc48240cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678e20c4-3016-4c77-b482-09ff455567f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:29 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume 39091d63-8e0e-4c1e-af1a-9849f4643111: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39091d63-8e0e-4c1e-af1a-9849f4643111', 'volume_size': 1} Sep 10 16:00:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:29 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[629f34d4-bada-4335-b02c-a08750d67c5c]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:00:29 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:00:29 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 16:00:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Flow 'volume_create_manager' (e5eac855-4578-4a72-a2ad-1e6acf089003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:00:29 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e8bfe77-ab99-4c6e-a368-783a9bea6583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_wl7wgcxwdevstack@QuobyteHD {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-37b00126-3368-47e7-b85d-933545d06dc1" returned: 0 in 1.139s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:30 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 16:00:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:00:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:00:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] <== create_volume: return (2471ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 16:00:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.513s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:30 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_wl7wgcxwdevstack@QuobyteHD Sep 10 16:00:30 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:00:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.499s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-635819341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=708d96e5-cd11-446c-bfb9-d1f2ab0830dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756f830313184cf3a2f6b485616af4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:00:24Z,use_quota=True,user_id='14d0eba009b34c3d98644747d200403c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 16:00:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Creating volume 708d96e5-cd11-446c-bfb9-d1f2ab0830dd {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 16:00:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:00:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:00:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 16:00:30 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 16:00:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-708d96e5-cd11-446c-bfb9-d1f2ab0830dd 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:30 devstack quobyte-client[82814]: System call of process 100485 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 16:00:30 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=151, name=volume-708d96e5-cd11-446c-bfb9-d1f2ab0830dd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1017dd84-6c8a-432b-bbd0-53feb15de3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37b00126-3368-47e7-b85d-933545d06dc1', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c9f5c7-fe0d-432b-a8c6-5fa7d8a97ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e8bfe77-ab99-4c6e-a368-783a9bea6583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-362980607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d976605e-86c8-471f-8a20-bd718027e965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05c6067af3df4c9c84de093744584348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:00:28Z,use_quota=True,user_id='b0e629555bda4006996c46b105075729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d796fc4f-cb76-40e6-9764-174faaefdd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d796fc4f-cb76-40e6-9764-174faaefdd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (586d9cd7-42eb-4f44-9dd0-32f72b75fd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (586d9cd7-42eb-4f44-9dd0-32f72b75fd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd976605e-86c8-471f-8a20-bd718027e965', 'volume_name': 'volume-d976605e-86c8-471f-8a20-bd718027e965', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d3700e-d6c5-4ca4-9772-cbf279a516f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d3700e-d6c5-4ca4-9772-cbf279a516f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c40e012-0875-406a-8088-201756f22e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:31 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume d976605e-86c8-471f-8a20-bd718027e965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d976605e-86c8-471f-8a20-bd718027e965', 'volume_size': 1} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:31 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Volume volume-37b00126-3368-47e7-b85d-933545d06dc1 (37b00126-3368-47e7-b85d-933545d06dc1): created successfully Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c9f5c7-fe0d-432b-a8c6-5fa7d8a97ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Flow 'volume_create_manager' (f9cab2c7-cbeb-4c84-9bae-44d00b36c71f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 1.147s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:31 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Flow 'volume_create_manager' (adddc887-a263-46ae-9881-64eedd6cd0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (173d60cd-9387-4db9-8db1-8f88fb199e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-708d96e5-cd11-446c-bfb9-d1f2ab0830dd 1073741824" returned: 0 in 0.822s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:31 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Flow 'volume_create_manager' (3af73317-333f-4539-8d89-a61379327c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01d15a0-b0b3-475f-a0a5-ab14d61f9c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-708d96e5-cd11-446c-bfb9-d1f2ab0830dd {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:31 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-d7427669-5478-413d-b8a3-44b58bd792ce tempest-CreateVolumesFromImageTest-1949445792 None] Created volume successfully. Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01d15a0-b0b3-475f-a0a5-ab14d61f9c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-344543861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=626d77ad-d5ff-41e7-ad27-da4f5cf67811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05c6067af3df4c9c84de093744584348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:00:30Z,use_quota=True,user_id='b0e629555bda4006996c46b105075729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75883d40-8e79-4ed3-b223-1e95248ff759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75883d40-8e79-4ed3-b223-1e95248ff759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e7852ea-9bc0-4e4a-9dac-79db4b07b6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e7852ea-9bc0-4e4a-9dac-79db4b07b6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '626d77ad-d5ff-41e7-ad27-da4f5cf67811', 'volume_name': 'volume-626d77ad-d5ff-41e7-ad27-da4f5cf67811', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63db59f8-0f83-4934-975f-c6f8ebc31c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63db59f8-0f83-4934-975f-c6f8ebc31c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eceb103c-f7c2-466d-937b-e46c8156f00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:31 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume 626d77ad-d5ff-41e7-ad27-da4f5cf67811: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-626d77ad-d5ff-41e7-ad27-da4f5cf67811', 'volume_size': 1} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:31 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 16:00:31 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Flow 'volume_create_manager' (3cb53577-2e53-4005-8b18-8ba39b667f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a5472a-428d-4378-b75a-508831b0c68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (173d60cd-9387-4db9-8db1-8f88fb199e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-232236647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1111477-1003-419e-81d5-fd21e98eeac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05c6067af3df4c9c84de093744584348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:00:29Z,use_quota=True,user_id='b0e629555bda4006996c46b105075729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7d1dcc-9d3d-44c8-8ce4-3bb812539aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7d1dcc-9d3d-44c8-8ce4-3bb812539aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef7c2a94-6eef-490e-8276-788e81ecc345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef7c2a94-6eef-490e-8276-788e81ecc345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1111477-1003-419e-81d5-fd21e98eeac1', 'volume_name': 'volume-f1111477-1003-419e-81d5-fd21e98eeac1', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61a23b09-013b-4762-9ad8-6e6fad62aca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61a23b09-013b-4762-9ad8-6e6fad62aca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4241544-556e-4ee7-a192-e6619fc852f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:32 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume f1111477-1003-419e-81d5-fd21e98eeac1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1111477-1003-419e-81d5-fd21e98eeac1', 'volume_size': 1} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-708d96e5-cd11-446c-bfb9-d1f2ab0830dd" returned: 0 in 0.717s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a5472a-428d-4378-b75a-508831b0c68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-134652810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c746468-182e-42cf-ac98-12f5e2fa34fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05c6067af3df4c9c84de093744584348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:00:29Z,use_quota=True,user_id='b0e629555bda4006996c46b105075729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000aaaef-dc78-4132-a2ff-aa7075dab02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000aaaef-dc78-4132-a2ff-aa7075dab02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d07a0c54-cc40-4293-b91a-6ac33705ebde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d07a0c54-cc40-4293-b91a-6ac33705ebde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c746468-182e-42cf-ac98-12f5e2fa34fd', 'volume_name': 'volume-8c746468-182e-42cf-ac98-12f5e2fa34fd', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d16cfa9-ff86-4719-b86d-1e5a5e55c1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d16cfa9-ff86-4719-b86d-1e5a5e55c1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03529983-196e-4b8f-b3fa-f69bf3fd0cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:32 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume 8c746468-182e-42cf-ac98-12f5e2fa34fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c746468-182e-42cf-ac98-12f5e2fa34fd', 'volume_size': 1} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] <== create_volume: return (1652ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.728s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-304844276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39091d63-8e0e-4c1e-af1a-9849f4643111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05c6067af3df4c9c84de093744584348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:00:28Z,use_quota=True,user_id='b0e629555bda4006996c46b105075729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Creating volume 39091d63-8e0e-4c1e-af1a-9849f4643111 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 16:00:32 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-39091d63-8e0e-4c1e-af1a-9849f4643111 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:32 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=152, name=volume-39091d63-8e0e-4c1e-af1a-9849f4643111, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d66fd13-9184-4637-aa9b-a9b9cc56bbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-708d96e5-cd11-446c-bfb9-d1f2ab0830dd', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (440317af-92fe-4bc9-aab5-a3b08a0d0d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:32 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Volume volume-708d96e5-cd11-446c-bfb9-d1f2ab0830dd (708d96e5-cd11-446c-bfb9-d1f2ab0830dd): created successfully Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (440317af-92fe-4bc9-aab5-a3b08a0d0d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Flow 'volume_create_manager' (80ef63cf-43f1-47b9-aedc-ab73911113cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-39091d63-8e0e-4c1e-af1a-9849f4643111 1073741824" returned: 0 in 0.715s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-39091d63-8e0e-4c1e-af1a-9849f4643111 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:33 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Sep 10 16:00:33 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-2c65a5cf-c840-4d16-8a96-46f279ce3853 tempest-CreateVolumesFromImageTest-1949445792 None] Created volume successfully. Sep 10 16:00:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_wl7wgcxwdevstack@QuobyteHD" returned: 0 in 3.664s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_wl7wgcxwdevstack@QuobyteHD {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-39091d63-8e0e-4c1e-af1a-9849f4643111" returned: 0 in 0.393s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:33 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] <== create_volume: return (1212ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 16:00:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.387s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:33 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-362980607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d976605e-86c8-471f-8a20-bd718027e965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05c6067af3df4c9c84de093744584348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:00:28Z,use_quota=True,user_id='b0e629555bda4006996c46b105075729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 16:00:33 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Creating volume d976605e-86c8-471f-8a20-bd718027e965 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 16:00:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:33 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:00:33 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:00:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:33 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 16:00:33 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 16:00:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-d976605e-86c8-471f-8a20-bd718027e965 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:33 devstack sudo[100495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_wl7wgcxwdevstack@QuobyteHD Sep 10 16:00:33 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:00:33 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=153, name=volume-d976605e-86c8-471f-8a20-bd718027e965, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 16:00:33 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678e20c4-3016-4c77-b482-09ff455567f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39091d63-8e0e-4c1e-af1a-9849f4643111', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:33 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d73ead15-2a99-4d94-959d-1dde0b765eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:34 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b0bd645e-ad3c-440a-951c-a328ffdd1aa4 tempest-CreateVolumesFromImageTest-1949445792 None] Acquiring lock "cinder-708d96e5-cd11-446c-bfb9-d1f2ab0830dd-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:00:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-d976605e-86c8-471f-8a20-bd718027e965 1073741824" returned: 0 in 0.734s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-d976605e-86c8-471f-8a20-bd718027e965 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:34 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b0bd645e-ad3c-440a-951c-a328ffdd1aa4 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "cinder-708d96e5-cd11-446c-bfb9-d1f2ab0830dd-delete_volume" acquired by "delete_volume" :: waited 0.277s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:00:34 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume volume-39091d63-8e0e-4c1e-af1a-9849f4643111 (39091d63-8e0e-4c1e-af1a-9849f4643111): created successfully Sep 10 16:00:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d73ead15-2a99-4d94-959d-1dde0b765eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:34 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Flow 'volume_create_manager' (a29b14df-91fd-4042-b999-1a11baf5b874) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:00:34 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-9bec8319-0f18-4886-a0d3-63193b2f3976 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Created volume successfully. Sep 10 16:00:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-d976605e-86c8-471f-8a20-bd718027e965" returned: 0 in 0.514s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:34 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] <== create_volume: return (1278ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 16:00:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.915s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:34 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-344543861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=626d77ad-d5ff-41e7-ad27-da4f5cf67811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05c6067af3df4c9c84de093744584348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:00:30Z,use_quota=True,user_id='b0e629555bda4006996c46b105075729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 16:00:34 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Creating volume 626d77ad-d5ff-41e7-ad27-da4f5cf67811 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 16:00:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:34 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:00:34 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:00:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:34 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 16:00:34 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 16:00:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-626d77ad-d5ff-41e7-ad27-da4f5cf67811 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:35 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=154, name=volume-626d77ad-d5ff-41e7-ad27-da4f5cf67811, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 16:00:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c40e012-0875-406a-8088-201756f22e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d976605e-86c8-471f-8a20-bd718027e965', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:35 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc89cbfd-96a6-497f-8861-0dc44829fa73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:35 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-b0bd645e-ad3c-440a-951c-a328ffdd1aa4 tempest-CreateVolumesFromImageTest-1949445792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:00:35 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b0bd645e-ad3c-440a-951c-a328ffdd1aa4 tempest-CreateVolumesFromImageTest-1949445792 None] Acquiring lock "cinder-quobyte-708d96e5-cd11-446c-bfb9-d1f2ab0830dd" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:00:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-626d77ad-d5ff-41e7-ad27-da4f5cf67811 1073741824" returned: 0 in 0.748s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:35 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b0bd645e-ad3c-440a-951c-a328ffdd1aa4 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "cinder-quobyte-708d96e5-cd11-446c-bfb9-d1f2ab0830dd" acquired by "delete_volume" :: waited 0.076s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:00:35 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-626d77ad-d5ff-41e7-ad27-da4f5cf67811 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:35 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[e682043d-7930-4e7d-9146-cb45b8ad500c]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:00:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b0bd645e-ad3c-440a-951c-a328ffdd1aa4 tempest-CreateVolumesFromImageTest-1949445792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-708d96e5-cd11-446c-bfb9-d1f2ab0830dd {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:36 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume volume-d976605e-86c8-471f-8a20-bd718027e965 (d976605e-86c8-471f-8a20-bd718027e965): created successfully Sep 10 16:00:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc89cbfd-96a6-497f-8861-0dc44829fa73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:36 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Flow 'volume_create_manager' (e5eac855-4578-4a72-a2ad-1e6acf089003) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:00:36 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root Sep 10 16:00:36 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-6214ea31-248c-4e56-9348-7964088a3a7f tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Created volume successfully. Sep 10 16:00:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-626d77ad-d5ff-41e7-ad27-da4f5cf67811" returned: 0 in 1.008s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_wl7wgcxwdevstack@QuobyteHD" returned: 1 in 3.425s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_wl7wgcxwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 16:00:36 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] <== create_volume: return (1811ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 16:00:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:36 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Temporary image 110f2ac1-722d-46c1-8c2c-8693c85b7bcd is fetched for user 4090827ce6b943f0b610d4c586e4a896. {{(pid=82800) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 10 16:00:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.662s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:36 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-232236647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1111477-1003-419e-81d5-fd21e98eeac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05c6067af3df4c9c84de093744584348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:00:29Z,use_quota=True,user_id='b0e629555bda4006996c46b105075729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 16:00:36 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Creating volume f1111477-1003-419e-81d5-fd21e98eeac1 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 16:00:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:36 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:00:36 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:00:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:36 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 16:00:36 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 16:00:36 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f1111477-1003-419e-81d5-fd21e98eeac1 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:36 devstack quobyte-client[82814]: System call of process 100511 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 16:00:36 devstack quobyte-client[82814]: System call of process 100511 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 16:00:36 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=155, name=volume-f1111477-1003-419e-81d5-fd21e98eeac1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 16:00:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eceb103c-f7c2-466d-937b-e46c8156f00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-626d77ad-d5ff-41e7-ad27-da4f5cf67811', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe2693b-1cae-4d8a-8159-5152bbe8134f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b0bd645e-ad3c-440a-951c-a328ffdd1aa4 tempest-CreateVolumesFromImageTest-1949445792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-708d96e5-cd11-446c-bfb9-d1f2ab0830dd" returned: 0 in 1.242s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b0bd645e-ad3c-440a-951c-a328ffdd1aa4 tempest-CreateVolumesFromImageTest-1949445792 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-708d96e5-cd11-446c-bfb9-d1f2ab0830dd {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f1111477-1003-419e-81d5-fd21e98eeac1 1073741824" returned: 0 in 0.759s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:37 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume volume-626d77ad-d5ff-41e7-ad27-da4f5cf67811 (626d77ad-d5ff-41e7-ad27-da4f5cf67811): created successfully Sep 10 16:00:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fe2693b-1cae-4d8a-8159-5152bbe8134f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:37 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Flow 'volume_create_manager' (3af73317-333f-4539-8d89-a61379327c32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:00:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f1111477-1003-419e-81d5-fd21e98eeac1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:37 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-091c1e35-42c2-4b2e-ab16-98c9778c13e8 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Created volume successfully. Sep 10 16:00:37 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[052021ea-5634-4db5-b32a-b74c7c32324c]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:00:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b0bd645e-ad3c-440a-951c-a328ffdd1aa4 tempest-CreateVolumesFromImageTest-1949445792 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-708d96e5-cd11-446c-bfb9-d1f2ab0830dd" returned: 0 in 0.675s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:37 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_wl7wgcxwdevstack@QuobyteHD {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f1111477-1003-419e-81d5-fd21e98eeac1" returned: 0 in 0.519s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:38 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b0bd645e-ad3c-440a-951c-a328ffdd1aa4 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "cinder-quobyte-708d96e5-cd11-446c-bfb9-d1f2ab0830dd" released by "delete_volume" :: held 2.618s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:00:38 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] <== create_volume: return (1565ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 16:00:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.269s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:38 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-134652810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c746468-182e-42cf-ac98-12f5e2fa34fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05c6067af3df4c9c84de093744584348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:00:29Z,use_quota=True,user_id='b0e629555bda4006996c46b105075729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 16:00:38 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Creating volume 8c746468-182e-42cf-ac98-12f5e2fa34fd {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 16:00:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:38 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:00:38 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:00:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:38 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 16:00:38 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 16:00:38 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c746468-182e-42cf-ac98-12f5e2fa34fd 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:38 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_wl7wgcxwdevstack@QuobyteHD Sep 10 16:00:38 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:00:38 devstack quobyte-client[82814]: System call of process 100518 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 16:00:38 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=156, name=volume-8c746468-182e-42cf-ac98-12f5e2fa34fd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 16:00:38 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4241544-556e-4ee7-a192-e6619fc852f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1111477-1003-419e-81d5-fd21e98eeac1', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:38 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d08a7d09-4668-446c-a6fd-33261cefc45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:38 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume volume-f1111477-1003-419e-81d5-fd21e98eeac1 (f1111477-1003-419e-81d5-fd21e98eeac1): created successfully Sep 10 16:00:38 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d08a7d09-4668-446c-a6fd-33261cefc45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:39 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Flow 'volume_create_manager' (adddc887-a263-46ae-9881-64eedd6cd0cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:00:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c746468-182e-42cf-ac98-12f5e2fa34fd 1073741824" returned: 0 in 0.588s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c746468-182e-42cf-ac98-12f5e2fa34fd {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:39 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-ff314f84-0043-4539-9ddc-1ed40fc4ffb1 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Created volume successfully. Sep 10 16:00:39 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-b0bd645e-ad3c-440a-951c-a328ffdd1aa4 tempest-CreateVolumesFromImageTest-1949445792 None] Created reservations ['c6d3b5ac-614d-4b17-9cc3-cb0542d99262', 'b970c03d-ce15-42e8-82bf-1d1619ca115e', '63259c62-cf50-4200-872b-51c70def7974', 'a194b0f9-f298-470f-92fe-8a65ba5d31c2'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:00:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c746468-182e-42cf-ac98-12f5e2fa34fd" returned: 0 in 0.576s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:39 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] <== create_volume: return (1198ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 16:00:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:39 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03529983-196e-4b8f-b3fa-f69bf3fd0cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c746468-182e-42cf-ac98-12f5e2fa34fd', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:39 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a7efdc8-62cb-4e64-8f2d-a6f47678701f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:39 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume volume-8c746468-182e-42cf-ac98-12f5e2fa34fd (8c746468-182e-42cf-ac98-12f5e2fa34fd): created successfully Sep 10 16:00:39 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a7efdc8-62cb-4e64-8f2d-a6f47678701f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:39 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Flow 'volume_create_manager' (3cb53577-2e53-4005-8b18-8ba39b667f45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:00:39 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-0d832aed-140b-48f6-8fe3-5064123d134d tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Created volume successfully. Sep 10 16:00:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b0bd645e-ad3c-440a-951c-a328ffdd1aa4 tempest-CreateVolumesFromImageTest-1949445792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b0bd645e-ad3c-440a-951c-a328ffdd1aa4 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:39 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b0bd645e-ad3c-440a-951c-a328ffdd1aa4 tempest-CreateVolumesFromImageTest-1949445792 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:00:39 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-b0bd645e-ad3c-440a-951c-a328ffdd1aa4 tempest-CreateVolumesFromImageTest-1949445792 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:00:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-b0bd645e-ad3c-440a-951c-a328ffdd1aa4 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b0bd645e-ad3c-440a-951c-a328ffdd1aa4 tempest-CreateVolumesFromImageTest-1949445792 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-b0bd645e-ad3c-440a-951c-a328ffdd1aa4 tempest-CreateVolumesFromImageTest-1949445792 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.215s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:40 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-b0bd645e-ad3c-440a-951c-a328ffdd1aa4 tempest-CreateVolumesFromImageTest-1949445792 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 16:00:40 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-b0bd645e-ad3c-440a-951c-a328ffdd1aa4 tempest-CreateVolumesFromImageTest-1949445792 None] Deleted volume successfully. Sep 10 16:00:40 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-b0bd645e-ad3c-440a-951c-a328ffdd1aa4 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "cinder-708d96e5-cd11-446c-bfb9-d1f2ab0830dd-delete_volume" released by "delete_volume" :: held 5.991s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:00:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-cfa943e1-bc6d-4f33-aa75-069eeecd6517 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "cinder-626d77ad-d5ff-41e7-ad27-da4f5cf67811-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:00:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-cda47499-4567-4ae1-9cb8-d58baeaf7fa5 tempest-CreateVolumesFromImageTest-1949445792 None] Acquiring lock "cinder-37b00126-3368-47e7-b85d-933545d06dc1-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:00:41 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Sep 10 16:00:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-cda47499-4567-4ae1-9cb8-d58baeaf7fa5 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "cinder-37b00126-3368-47e7-b85d-933545d06dc1-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:00:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-cfa943e1-bc6d-4f33-aa75-069eeecd6517 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "cinder-626d77ad-d5ff-41e7-ad27-da4f5cf67811-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:00:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_wl7wgcxwdevstack@QuobyteHD" returned: 0 in 3.155s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_wl7wgcxwdevstack@QuobyteHD {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:41 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-cda47499-4567-4ae1-9cb8-d58baeaf7fa5 tempest-CreateVolumesFromImageTest-1949445792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:00:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-cda47499-4567-4ae1-9cb8-d58baeaf7fa5 tempest-CreateVolumesFromImageTest-1949445792 None] Acquiring lock "cinder-quobyte-37b00126-3368-47e7-b85d-933545d06dc1" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:00:41 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-cfa943e1-bc6d-4f33-aa75-069eeecd6517 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:00:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-cfa943e1-bc6d-4f33-aa75-069eeecd6517 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "cinder-quobyte-626d77ad-d5ff-41e7-ad27-da4f5cf67811" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:00:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-cda47499-4567-4ae1-9cb8-d58baeaf7fa5 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "cinder-quobyte-37b00126-3368-47e7-b85d-933545d06dc1" acquired by "delete_volume" :: waited 0.069s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:00:41 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[a194e353-4606-4913-a27e-a949908ceac1]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:00:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cda47499-4567-4ae1-9cb8-d58baeaf7fa5 tempest-CreateVolumesFromImageTest-1949445792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-37b00126-3368-47e7-b85d-933545d06dc1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:41 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_wl7wgcxwdevstack@QuobyteHD Sep 10 16:00:41 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 10 16:00:41 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-cfa943e1-bc6d-4f33-aa75-069eeecd6517 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "cinder-quobyte-626d77ad-d5ff-41e7-ad27-da4f5cf67811" acquired by "delete_volume" :: waited 0.221s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:00:41 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a553a97-f62b-4f39-b831-e2bbc1697747]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:00:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cfa943e1-bc6d-4f33-aa75-069eeecd6517 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-626d77ad-d5ff-41e7-ad27-da4f5cf67811 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cda47499-4567-4ae1-9cb8-d58baeaf7fa5 tempest-CreateVolumesFromImageTest-1949445792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-37b00126-3368-47e7-b85d-933545d06dc1" returned: 0 in 0.690s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cda47499-4567-4ae1-9cb8-d58baeaf7fa5 tempest-CreateVolumesFromImageTest-1949445792 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-37b00126-3368-47e7-b85d-933545d06dc1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cda47499-4567-4ae1-9cb8-d58baeaf7fa5 tempest-CreateVolumesFromImageTest-1949445792 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-37b00126-3368-47e7-b85d-933545d06dc1" returned: 0 in 0.212s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cfa943e1-bc6d-4f33-aa75-069eeecd6517 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-626d77ad-d5ff-41e7-ad27-da4f5cf67811" returned: 0 in 0.768s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cfa943e1-bc6d-4f33-aa75-069eeecd6517 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-626d77ad-d5ff-41e7-ad27-da4f5cf67811 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:42 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-cda47499-4567-4ae1-9cb8-d58baeaf7fa5 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "cinder-quobyte-37b00126-3368-47e7-b85d-933545d06dc1" released by "delete_volume" :: held 1.232s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:00:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cfa943e1-bc6d-4f33-aa75-069eeecd6517 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-626d77ad-d5ff-41e7-ad27-da4f5cf67811" returned: 0 in 0.356s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:43 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-cfa943e1-bc6d-4f33-aa75-069eeecd6517 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "cinder-quobyte-626d77ad-d5ff-41e7-ad27-da4f5cf67811" released by "delete_volume" :: held 1.363s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:00:43 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-cfa943e1-bc6d-4f33-aa75-069eeecd6517 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Created reservations ['8f14f074-c7bc-4478-8e0d-cce70297266c', '694d6bd2-cf5c-4d5b-adba-1281c27e1062', '77726457-2011-4047-b4a0-87bb2093a7f5', 'b0ca4515-bb3d-4a9c-adf7-27cee25682cc'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:00:43 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-cda47499-4567-4ae1-9cb8-d58baeaf7fa5 tempest-CreateVolumesFromImageTest-1949445792 None] Created reservations ['2c0e6ea9-4b72-47bf-a249-d35a039a4903', '307de4d7-b5c6-4eaa-b554-31173b02b76b', '1c0b2d87-fc42-4c48-ab71-d714f57e63a0', 'c960fa40-4ba3-46c8-8a2c-8ee99fce639b'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:00:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-cfa943e1-bc6d-4f33-aa75-069eeecd6517 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-cfa943e1-bc6d-4f33-aa75-069eeecd6517 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:43 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-cfa943e1-bc6d-4f33-aa75-069eeecd6517 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:00:43 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-cfa943e1-bc6d-4f33-aa75-069eeecd6517 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:00:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-cfa943e1-bc6d-4f33-aa75-069eeecd6517 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cfa943e1-bc6d-4f33-aa75-069eeecd6517 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cfa943e1-bc6d-4f33-aa75-069eeecd6517 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.355s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:43 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-cfa943e1-bc6d-4f33-aa75-069eeecd6517 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 16:00:44 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-cfa943e1-bc6d-4f33-aa75-069eeecd6517 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Deleted volume successfully. Sep 10 16:00:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-cda47499-4567-4ae1-9cb8-d58baeaf7fa5 tempest-CreateVolumesFromImageTest-1949445792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-cda47499-4567-4ae1-9cb8-d58baeaf7fa5 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-cda47499-4567-4ae1-9cb8-d58baeaf7fa5 tempest-CreateVolumesFromImageTest-1949445792 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:00:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-cda47499-4567-4ae1-9cb8-d58baeaf7fa5 tempest-CreateVolumesFromImageTest-1949445792 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:00:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-cda47499-4567-4ae1-9cb8-d58baeaf7fa5 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cda47499-4567-4ae1-9cb8-d58baeaf7fa5 tempest-CreateVolumesFromImageTest-1949445792 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:44 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Sep 10 16:00:44 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-cfa943e1-bc6d-4f33-aa75-069eeecd6517 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "cinder-626d77ad-d5ff-41e7-ad27-da4f5cf67811-delete_volume" released by "delete_volume" :: held 3.368s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:00:44 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-bde9d834-6585-4245-8bcd-8421f7e8bb2b tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "cinder-8c746468-182e-42cf-ac98-12f5e2fa34fd-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:00:44 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d7edbe5e-3b1a-4120-8503-24dd08af0767 tempest-CreateVolumesFromImageTest-1949445792 None] Acquiring lock "cinder-4b7fad86-5260-4a20-abf1-984fa4659eb8-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:00:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_wl7wgcxwdevstack@QuobyteHD" returned: 1 in 3.559s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_wl7wgcxwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 16:00:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07cd259f-5d33-4958-b680-395cc0827456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='939da4efd2744decaeed6fe0d480528e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:00:25Z,use_quota=True,user_id='4090827ce6b943f0b610d4c586e4a896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 16:00:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Creating volume 07cd259f-5d33-4958-b680-395cc0827456 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 16:00:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:00:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:00:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 16:00:44 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 16:00:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-07cd259f-5d33-4958-b680-395cc0827456 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:44 devstack quobyte-client[82814]: System call of process 100542 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 16:00:44 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=157, name=volume-07cd259f-5d33-4958-b680-395cc0827456, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 16:00:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cda47499-4567-4ae1-9cb8-d58baeaf7fa5 tempest-CreateVolumesFromImageTest-1949445792 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.696s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:44 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-cda47499-4567-4ae1-9cb8-d58baeaf7fa5 tempest-CreateVolumesFromImageTest-1949445792 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 16:00:45 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d7edbe5e-3b1a-4120-8503-24dd08af0767 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "cinder-4b7fad86-5260-4a20-abf1-984fa4659eb8-delete_volume" acquired by "delete_volume" :: waited 0.321s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:00:45 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-bde9d834-6585-4245-8bcd-8421f7e8bb2b tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "cinder-8c746468-182e-42cf-ac98-12f5e2fa34fd-delete_volume" acquired by "delete_volume" :: waited 0.529s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:00:45 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-cda47499-4567-4ae1-9cb8-d58baeaf7fa5 tempest-CreateVolumesFromImageTest-1949445792 None] Deleted volume successfully. Sep 10 16:00:45 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-d7edbe5e-3b1a-4120-8503-24dd08af0767 tempest-CreateVolumesFromImageTest-1949445792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:00:45 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d7edbe5e-3b1a-4120-8503-24dd08af0767 tempest-CreateVolumesFromImageTest-1949445792 None] Acquiring lock "cinder-quobyte-4b7fad86-5260-4a20-abf1-984fa4659eb8" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:00:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-07cd259f-5d33-4958-b680-395cc0827456 1073741824" returned: 0 in 0.601s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-07cd259f-5d33-4958-b680-395cc0827456 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:45 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-cda47499-4567-4ae1-9cb8-d58baeaf7fa5 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "cinder-37b00126-3368-47e7-b85d-933545d06dc1-delete_volume" released by "delete_volume" :: held 4.622s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:00:45 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-bde9d834-6585-4245-8bcd-8421f7e8bb2b tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:00:45 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-bde9d834-6585-4245-8bcd-8421f7e8bb2b tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "cinder-quobyte-8c746468-182e-42cf-ac98-12f5e2fa34fd" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:00:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-07cd259f-5d33-4958-b680-395cc0827456" returned: 0 in 0.421s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:45 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d7edbe5e-3b1a-4120-8503-24dd08af0767 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "cinder-quobyte-4b7fad86-5260-4a20-abf1-984fa4659eb8" acquired by "delete_volume" :: waited 0.434s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:00:45 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] <== create_volume: return (1068ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 16:00:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:45 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc91c39-4056-4166-883c-80609a7be508]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:00:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d7edbe5e-3b1a-4120-8503-24dd08af0767 tempest-CreateVolumesFromImageTest-1949445792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b7fad86-5260-4a20-abf1-984fa4659eb8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:46 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-bde9d834-6585-4245-8bcd-8421f7e8bb2b tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "cinder-quobyte-8c746468-182e-42cf-ac98-12f5e2fa34fd" acquired by "delete_volume" :: waited 0.386s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:00:46 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e407616-0938-493d-bc10-f74b99be65ac]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:00:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bde9d834-6585-4245-8bcd-8421f7e8bb2b tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c746468-182e-42cf-ac98-12f5e2fa34fd {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:46 devstack cinder-volume[82800]: DEBUG cinder.volume.volume_utils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Attempting download of 110f2ac1-722d-46c1-8c2c-8693c85b7bcd ((None, None)) to volume 07cd259f-5d33-4958-b680-395cc0827456. {{(pid=82800) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 10 16:00:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d7edbe5e-3b1a-4120-8503-24dd08af0767 tempest-CreateVolumesFromImageTest-1949445792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b7fad86-5260-4a20-abf1-984fa4659eb8" returned: 0 in 0.654s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d7edbe5e-3b1a-4120-8503-24dd08af0767 tempest-CreateVolumesFromImageTest-1949445792 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b7fad86-5260-4a20-abf1-984fa4659eb8 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d7edbe5e-3b1a-4120-8503-24dd08af0767 tempest-CreateVolumesFromImageTest-1949445792 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4b7fad86-5260-4a20-abf1-984fa4659eb8" returned: 0 in 0.206s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:46 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8de8cb0-d2de-4dd4-9095-3c5e27d071f3]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:00:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_n7jx5d6y {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:47 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d7edbe5e-3b1a-4120-8503-24dd08af0767 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "cinder-quobyte-4b7fad86-5260-4a20-abf1-984fa4659eb8" released by "delete_volume" :: held 1.193s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:00:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bde9d834-6585-4245-8bcd-8421f7e8bb2b tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c746468-182e-42cf-ac98-12f5e2fa34fd" returned: 0 in 0.950s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bde9d834-6585-4245-8bcd-8421f7e8bb2b tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c746468-182e-42cf-ac98-12f5e2fa34fd {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bde9d834-6585-4245-8bcd-8421f7e8bb2b tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8c746468-182e-42cf-ac98-12f5e2fa34fd" returned: 0 in 0.255s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_n7jx5d6y" returned: 0 in 0.667s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_n7jx5d6y {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:47 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-bde9d834-6585-4245-8bcd-8421f7e8bb2b tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "cinder-quobyte-8c746468-182e-42cf-ac98-12f5e2fa34fd" released by "delete_volume" :: held 1.606s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:00:48 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-d7edbe5e-3b1a-4120-8503-24dd08af0767 tempest-CreateVolumesFromImageTest-1949445792 None] Created reservations ['05b14e66-c8a5-42b3-9017-75bf68941f08', 'c31d3cf9-8c34-4504-b4eb-36ab7348d5fc', 'e189b632-b9d3-48c2-bf06-6723195e6609', '635ed7d8-a0b5-4d6c-a713-e60d74546444'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:00:48 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-bde9d834-6585-4245-8bcd-8421f7e8bb2b tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Created reservations ['84d0fcff-d7c8-4d28-9243-cae8c7a765a8', 'eab34565-9750-430d-86ac-3eaa729a3c14', 'bbd32ec8-c0b2-4109-b54d-047fc3419c3c', '1cce8d63-6ce4-40db-b7c7-86c17e1532fc'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:00:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_n7jx5d6y" returned: 1 in 0.539s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_n7jx5d6y' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 16:00:48 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ec3f13-0a1c-45fc-8f9a-5f086dbacc4c]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:00:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_wl7wgcxwdevstack@QuobyteHD {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d7edbe5e-3b1a-4120-8503-24dd08af0767 tempest-CreateVolumesFromImageTest-1949445792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d7edbe5e-3b1a-4120-8503-24dd08af0767 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:48 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d7edbe5e-3b1a-4120-8503-24dd08af0767 tempest-CreateVolumesFromImageTest-1949445792 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:00:48 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d7edbe5e-3b1a-4120-8503-24dd08af0767 tempest-CreateVolumesFromImageTest-1949445792 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:00:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d7edbe5e-3b1a-4120-8503-24dd08af0767 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d7edbe5e-3b1a-4120-8503-24dd08af0767 tempest-CreateVolumesFromImageTest-1949445792 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d7edbe5e-3b1a-4120-8503-24dd08af0767 tempest-CreateVolumesFromImageTest-1949445792 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.249s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_wl7wgcxwdevstack@QuobyteHD" returned: 0 in 0.709s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:48 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-d7edbe5e-3b1a-4120-8503-24dd08af0767 tempest-CreateVolumesFromImageTest-1949445792 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 16:00:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_wl7wgcxwdevstack@QuobyteHD {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:48 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-d7edbe5e-3b1a-4120-8503-24dd08af0767 tempest-CreateVolumesFromImageTest-1949445792 None] Deleted volume successfully. Sep 10 16:00:49 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0e85ba8d-4a73-4174-a16c-519e5daa706b tempest-CreateVolumesFromImageTest-1949445792 None] Acquiring lock "cinder-bcac9bf0-9174-46e2-8935-c63679e432df-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:00:49 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0537047c-499b-41be-bd63-b68b8a936336 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "cinder-f1111477-1003-419e-81d5-fd21e98eeac1-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:00:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_wl7wgcxwdevstack@QuobyteHD" returned: 1 in 0.612s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_wl7wgcxwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 16:00:49 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] 110f2ac1-722d-46c1-8c2c-8693c85b7bcd was raw, converting to raw {{(pid=82800) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 10 16:00:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_wl7wgcxwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-07cd259f-5d33-4958-b680-395cc0827456 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:49 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d7edbe5e-3b1a-4120-8503-24dd08af0767 tempest-CreateVolumesFromImageTest-1949445792 None] Lock "cinder-4b7fad86-5260-4a20-abf1-984fa4659eb8-delete_volume" released by "delete_volume" :: held 4.584s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:00:49 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=157, name=volume-07cd259f-5d33-4958-b680-395cc0827456, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 16:00:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-bde9d834-6585-4245-8bcd-8421f7e8bb2b tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-bde9d834-6585-4245-8bcd-8421f7e8bb2b tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:49 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-bde9d834-6585-4245-8bcd-8421f7e8bb2b tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:00:49 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-bde9d834-6585-4245-8bcd-8421f7e8bb2b tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:00:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-bde9d834-6585-4245-8bcd-8421f7e8bb2b tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bde9d834-6585-4245-8bcd-8421f7e8bb2b tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:49 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0537047c-499b-41be-bd63-b68b8a936336 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "cinder-f1111477-1003-419e-81d5-fd21e98eeac1-delete_volume" acquired by "delete_volume" :: waited 0.485s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:00:50 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0e85ba8d-4a73-4174-a16c-519e5daa706b tempest-CreateVolumesFromImageTest-1949445792 None] Lock "cinder-bcac9bf0-9174-46e2-8935-c63679e432df-delete_volume" acquired by "delete_volume" :: waited 0.718s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:00:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_wl7wgcxwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-07cd259f-5d33-4958-b680-395cc0827456" returned: 0 in 0.652s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:50 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_110f2ac1-722d-46c1-8c2c-8693c85b7bcd_wl7wgcxwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-07cd259f-5d33-4958-b680-395cc0827456 {{(pid=82800) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 16:00:50 devstack cinder-volume[82800]: INFO cinder.image.image_utils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Converted 0.00 MB image at 0.00 MB/s Sep 10 16:00:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-07cd259f-5d33-4958-b680-395cc0827456 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:50 devstack quobyte-client[82814]: System call of process 100568 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 16:00:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-bde9d834-6585-4245-8bcd-8421f7e8bb2b tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.564s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:50 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-bde9d834-6585-4245-8bcd-8421f7e8bb2b tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 16:00:50 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-bde9d834-6585-4245-8bcd-8421f7e8bb2b tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Deleted volume successfully. Sep 10 16:00:50 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-0537047c-499b-41be-bd63-b68b8a936336 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:00:50 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0537047c-499b-41be-bd63-b68b8a936336 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "cinder-quobyte-f1111477-1003-419e-81d5-fd21e98eeac1" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:00:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-07cd259f-5d33-4958-b680-395cc0827456 1G" returned: 0 in 0.494s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:50 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-0e85ba8d-4a73-4174-a16c-519e5daa706b tempest-CreateVolumesFromImageTest-1949445792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:00:50 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0e85ba8d-4a73-4174-a16c-519e5daa706b tempest-CreateVolumesFromImageTest-1949445792 None] Acquiring lock "cinder-quobyte-bcac9bf0-9174-46e2-8935-c63679e432df" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:00:50 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0537047c-499b-41be-bd63-b68b8a936336 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "cinder-quobyte-f1111477-1003-419e-81d5-fd21e98eeac1" acquired by "delete_volume" :: waited 0.080s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:00:50 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-bde9d834-6585-4245-8bcd-8421f7e8bb2b tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "cinder-8c746468-182e-42cf-ac98-12f5e2fa34fd-delete_volume" released by "delete_volume" :: held 5.521s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:00:50 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[915f5a6d-69fe-4554-949e-80cf64fb1432]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:00:50 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0537047c-499b-41be-bd63-b68b8a936336 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f1111477-1003-419e-81d5-fd21e98eeac1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:50 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd826d6e-8c78-446a-b242-c8449bf9d32e]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:00:50 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0e85ba8d-4a73-4174-a16c-519e5daa706b tempest-CreateVolumesFromImageTest-1949445792 None] Lock "cinder-quobyte-bcac9bf0-9174-46e2-8935-c63679e432df" acquired by "delete_volume" :: waited 0.220s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:00:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-07cd259f-5d33-4958-b680-395cc0827456 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:51 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[933bded3-21cc-4c51-8003-5733c5ed0ea5]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:00:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0e85ba8d-4a73-4174-a16c-519e5daa706b tempest-CreateVolumesFromImageTest-1949445792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bcac9bf0-9174-46e2-8935-c63679e432df {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0537047c-499b-41be-bd63-b68b8a936336 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f1111477-1003-419e-81d5-fd21e98eeac1" returned: 0 in 0.617s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0537047c-499b-41be-bd63-b68b8a936336 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f1111477-1003-419e-81d5-fd21e98eeac1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0537047c-499b-41be-bd63-b68b8a936336 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-f1111477-1003-419e-81d5-fd21e98eeac1" returned: 0 in 0.204s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-07cd259f-5d33-4958-b680-395cc0827456" returned: 0 in 0.740s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-07cd259f-5d33-4958-b680-395cc0827456 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:51 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0537047c-499b-41be-bd63-b68b8a936336 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "cinder-quobyte-f1111477-1003-419e-81d5-fd21e98eeac1" released by "delete_volume" :: held 1.178s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:00:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0e85ba8d-4a73-4174-a16c-519e5daa706b tempest-CreateVolumesFromImageTest-1949445792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bcac9bf0-9174-46e2-8935-c63679e432df" returned: 0 in 1.003s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0e85ba8d-4a73-4174-a16c-519e5daa706b tempest-CreateVolumesFromImageTest-1949445792 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bcac9bf0-9174-46e2-8935-c63679e432df {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0e85ba8d-4a73-4174-a16c-519e5daa706b tempest-CreateVolumesFromImageTest-1949445792 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bcac9bf0-9174-46e2-8935-c63679e432df" returned: 0 in 0.299s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-07cd259f-5d33-4958-b680-395cc0827456" returned: 1 in 0.763s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-07cd259f-5d33-4958-b680-395cc0827456' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 16:00:52 devstack cinder-volume[82800]: DEBUG cinder.volume.volume_utils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Downloaded image 110f2ac1-722d-46c1-8c2c-8693c85b7bcd ((None, None)) to volume 07cd259f-5d33-4958-b680-395cc0827456 successfully. {{(pid=82800) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 10 16:00:52 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Temporary image 110f2ac1-722d-46c1-8c2c-8693c85b7bcd for user 4090827ce6b943f0b610d4c586e4a896 is deleted. {{(pid=82800) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 10 16:00:52 devstack cinder-volume[82800]: DEBUG cinder.volume.volume_utils [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Marking volume 07cd259f-5d33-4958-b680-395cc0827456 as bootable. {{(pid=82800) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 10 16:00:52 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0e85ba8d-4a73-4174-a16c-519e5daa706b tempest-CreateVolumesFromImageTest-1949445792 None] Lock "cinder-quobyte-bcac9bf0-9174-46e2-8935-c63679e432df" released by "delete_volume" :: held 1.666s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:00:52 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Copying metadata from image 110f2ac1-722d-46c1-8c2c-8693c85b7bcd to 07cd259f-5d33-4958-b680-395cc0827456. {{(pid=82800) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 10 16:00:52 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Creating volume glance metadata for volume 07cd259f-5d33-4958-b680-395cc0827456 backed by image 110f2ac1-722d-46c1-8c2c-8693c85b7bcd with: {'image_id': '110f2ac1-722d-46c1-8c2c-8693c85b7bcd', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c23d46d8e9e6facab6a0b9df21e8b34d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=82800) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 10 16:00:52 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-0537047c-499b-41be-bd63-b68b8a936336 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Created reservations ['08b01865-8973-404b-afff-ee0b059a84ea', '30f17824-8e42-450c-9c87-3d1736819b20', '798f5634-7e1e-4d9b-bbd8-7f3626eab34a', '2978d3c1-8954-4b8b-b391-2f598ea4b163'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:00:52 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-0e85ba8d-4a73-4174-a16c-519e5daa706b tempest-CreateVolumesFromImageTest-1949445792 None] Created reservations ['54cffd8e-990a-4158-ad90-c7415bea1954', '23ab9c9d-7571-49b2-9ba6-1c660e6f6422', 'f0acb742-a9ec-4e8e-a2a2-4f0c88a08de8', '3b7316a1-abf8-406f-97de-f22f87b8b6a7'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:00:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc6970a5-4ed5-46b1-98f9-e5125289af96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07cd259f-5d33-4958-b680-395cc0827456', 'volume_size': 1, 'image_id': '110f2ac1-722d-46c1-8c2c-8693c85b7bcd', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c23d46d8e9e6facab6a0b9df21e8b34d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '939da4efd2744decaeed6fe0d480528e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ece723021aff7d3692924bdf2c9aa0fca23e12d523f4b9d58f055c576def593d68b83df3ff184d7a46ff860d856a6adfb1eea9d503afd2917dcdc94d9bf3bae8', 'id': '110f2ac1-722d-46c1-8c2c-8693c85b7bcd', 'created_at': datetime.datetime(2025, 9, 10, 14, 0, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 10, 14, 0, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/110f2ac1-722d-46c1-8c2c-8693c85b7bcd/file', 'properties': {}}, 'image_service': }' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e62a5db-ccd4-4066-b085-598670e5ec3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:00:52 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Volume volume-07cd259f-5d33-4958-b680-395cc0827456 (07cd259f-5d33-4958-b680-395cc0827456): created successfully Sep 10 16:00:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e62a5db-ccd4-4066-b085-598670e5ec3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:00:52 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Flow 'volume_create_manager' (f4a0f91d-483c-4b1a-ae91-44c4f816a231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:00:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0537047c-499b-41be-bd63-b68b8a936336 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0537047c-499b-41be-bd63-b68b8a936336 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0537047c-499b-41be-bd63-b68b8a936336 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:00:52 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0537047c-499b-41be-bd63-b68b8a936336 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:00:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0537047c-499b-41be-bd63-b68b8a936336 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0537047c-499b-41be-bd63-b68b8a936336 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0e85ba8d-4a73-4174-a16c-519e5daa706b tempest-CreateVolumesFromImageTest-1949445792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0e85ba8d-4a73-4174-a16c-519e5daa706b tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0e85ba8d-4a73-4174-a16c-519e5daa706b tempest-CreateVolumesFromImageTest-1949445792 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:00:53 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-0e85ba8d-4a73-4174-a16c-519e5daa706b tempest-CreateVolumesFromImageTest-1949445792 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:00:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-0e85ba8d-4a73-4174-a16c-519e5daa706b tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0e85ba8d-4a73-4174-a16c-519e5daa706b tempest-CreateVolumesFromImageTest-1949445792 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:53 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-2ad3e029-edc5-4dbe-a34e-533fa6591213 tempest-VolumeImageDependencyTests-301133217 None] Created volume successfully. Sep 10 16:00:53 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e2e3b396-03f1-4778-b1f2-1e4ec71f6298 tempest-VolumeImageDependencyTests-301133217 None] Acquiring lock "cinder-07cd259f-5d33-4958-b680-395cc0827456-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:00:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0537047c-499b-41be-bd63-b68b8a936336 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.612s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:53 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-0537047c-499b-41be-bd63-b68b8a936336 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 16:00:53 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-0537047c-499b-41be-bd63-b68b8a936336 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Deleted volume successfully. Sep 10 16:00:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-0e85ba8d-4a73-4174-a16c-519e5daa706b tempest-CreateVolumesFromImageTest-1949445792 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.465s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:53 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-0e85ba8d-4a73-4174-a16c-519e5daa706b tempest-CreateVolumesFromImageTest-1949445792 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 16:00:53 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e2e3b396-03f1-4778-b1f2-1e4ec71f6298 tempest-VolumeImageDependencyTests-301133217 None] Lock "cinder-07cd259f-5d33-4958-b680-395cc0827456-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:00:53 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-0e85ba8d-4a73-4174-a16c-519e5daa706b tempest-CreateVolumesFromImageTest-1949445792 None] Deleted volume successfully. Sep 10 16:00:53 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0537047c-499b-41be-bd63-b68b8a936336 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "cinder-f1111477-1003-419e-81d5-fd21e98eeac1-delete_volume" released by "delete_volume" :: held 3.793s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:00:53 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-0e85ba8d-4a73-4174-a16c-519e5daa706b tempest-CreateVolumesFromImageTest-1949445792 None] Lock "cinder-bcac9bf0-9174-46e2-8935-c63679e432df-delete_volume" released by "delete_volume" :: held 3.646s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:00:53 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-e2e3b396-03f1-4778-b1f2-1e4ec71f6298 tempest-VolumeImageDependencyTests-301133217 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:00:53 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e2e3b396-03f1-4778-b1f2-1e4ec71f6298 tempest-VolumeImageDependencyTests-301133217 None] Acquiring lock "cinder-quobyte-07cd259f-5d33-4958-b680-395cc0827456" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:00:53 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e2e3b396-03f1-4778-b1f2-1e4ec71f6298 tempest-VolumeImageDependencyTests-301133217 None] Lock "cinder-quobyte-07cd259f-5d33-4958-b680-395cc0827456" acquired by "delete_volume" :: waited 0.012s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:00:53 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9ff2282e-f9f9-48ec-a1aa-d1be8f5da3ba tempest-CreateVolumesFromImageTest-1949445792 None] Acquiring lock "cinder-4a1df3fe-c997-4797-a10a-9b742b6de40d-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:00:53 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[591e8a09-b8b0-4e0a-acef-28aab9a9e678]: (4, 'raw') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:00:53 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e2e3b396-03f1-4778-b1f2-1e4ec71f6298 tempest-VolumeImageDependencyTests-301133217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-07cd259f-5d33-4958-b680-395cc0827456 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e7595502-59d1-4fa5-be8e-221e428aae1c tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "cinder-d976605e-86c8-471f-8a20-bd718027e965-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:00:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9ff2282e-f9f9-48ec-a1aa-d1be8f5da3ba tempest-CreateVolumesFromImageTest-1949445792 None] Lock "cinder-4a1df3fe-c997-4797-a10a-9b742b6de40d-delete_volume" acquired by "delete_volume" :: waited 0.336s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:00:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e7595502-59d1-4fa5-be8e-221e428aae1c tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "cinder-d976605e-86c8-471f-8a20-bd718027e965-delete_volume" acquired by "delete_volume" :: waited 0.180s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:00:54 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-9ff2282e-f9f9-48ec-a1aa-d1be8f5da3ba tempest-CreateVolumesFromImageTest-1949445792 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:00:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9ff2282e-f9f9-48ec-a1aa-d1be8f5da3ba tempest-CreateVolumesFromImageTest-1949445792 None] Acquiring lock "cinder-quobyte-4a1df3fe-c997-4797-a10a-9b742b6de40d" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:00:54 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-e7595502-59d1-4fa5-be8e-221e428aae1c tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:00:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e7595502-59d1-4fa5-be8e-221e428aae1c tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "cinder-quobyte-d976605e-86c8-471f-8a20-bd718027e965" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:00:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9ff2282e-f9f9-48ec-a1aa-d1be8f5da3ba tempest-CreateVolumesFromImageTest-1949445792 None] Lock "cinder-quobyte-4a1df3fe-c997-4797-a10a-9b742b6de40d" acquired by "delete_volume" :: waited 0.036s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:00:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e2e3b396-03f1-4778-b1f2-1e4ec71f6298 tempest-VolumeImageDependencyTests-301133217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-07cd259f-5d33-4958-b680-395cc0827456" returned: 0 in 0.645s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:54 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[294b6a50-3a0b-4ce8-a57d-24282e7aafd6]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:00:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e2e3b396-03f1-4778-b1f2-1e4ec71f6298 tempest-VolumeImageDependencyTests-301133217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-07cd259f-5d33-4958-b680-395cc0827456 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9ff2282e-f9f9-48ec-a1aa-d1be8f5da3ba tempest-CreateVolumesFromImageTest-1949445792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4a1df3fe-c997-4797-a10a-9b742b6de40d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e7595502-59d1-4fa5-be8e-221e428aae1c tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "cinder-quobyte-d976605e-86c8-471f-8a20-bd718027e965" acquired by "delete_volume" :: waited 0.283s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:00:54 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edaa8c8-8ce4-4014-872c-3e4967cbf2d8]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:00:54 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e7595502-59d1-4fa5-be8e-221e428aae1c tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-d976605e-86c8-471f-8a20-bd718027e965 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:55 devstack quobyte-client[82814]: System call of process 100592 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 16:00:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e2e3b396-03f1-4778-b1f2-1e4ec71f6298 tempest-VolumeImageDependencyTests-301133217 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-07cd259f-5d33-4958-b680-395cc0827456" returned: 1 in 0.675s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e2e3b396-03f1-4778-b1f2-1e4ec71f6298 tempest-VolumeImageDependencyTests-301133217 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-07cd259f-5d33-4958-b680-395cc0827456' failed. Not Retrying. {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 10 16:00:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e2e3b396-03f1-4778-b1f2-1e4ec71f6298 tempest-VolumeImageDependencyTests-301133217 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-07cd259f-5d33-4958-b680-395cc0827456 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9ff2282e-f9f9-48ec-a1aa-d1be8f5da3ba tempest-CreateVolumesFromImageTest-1949445792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4a1df3fe-c997-4797-a10a-9b742b6de40d" returned: 0 in 0.785s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9ff2282e-f9f9-48ec-a1aa-d1be8f5da3ba tempest-CreateVolumesFromImageTest-1949445792 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4a1df3fe-c997-4797-a10a-9b742b6de40d {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:55 devstack quobyte-client[82814]: System call of process 100594 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 16:00:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e2e3b396-03f1-4778-b1f2-1e4ec71f6298 tempest-VolumeImageDependencyTests-301133217 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-07cd259f-5d33-4958-b680-395cc0827456" returned: 0 in 0.240s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e7595502-59d1-4fa5-be8e-221e428aae1c tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-d976605e-86c8-471f-8a20-bd718027e965" returned: 0 in 0.738s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:55 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e2e3b396-03f1-4778-b1f2-1e4ec71f6298 tempest-VolumeImageDependencyTests-301133217 None] Lock "cinder-quobyte-07cd259f-5d33-4958-b680-395cc0827456" released by "delete_volume" :: held 1.826s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:00:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e7595502-59d1-4fa5-be8e-221e428aae1c tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-d976605e-86c8-471f-8a20-bd718027e965 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9ff2282e-f9f9-48ec-a1aa-d1be8f5da3ba tempest-CreateVolumesFromImageTest-1949445792 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-4a1df3fe-c997-4797-a10a-9b742b6de40d" returned: 0 in 0.545s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e7595502-59d1-4fa5-be8e-221e428aae1c tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-d976605e-86c8-471f-8a20-bd718027e965" returned: 0 in 0.318s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:56 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9ff2282e-f9f9-48ec-a1aa-d1be8f5da3ba tempest-CreateVolumesFromImageTest-1949445792 None] Lock "cinder-quobyte-4a1df3fe-c997-4797-a10a-9b742b6de40d" released by "delete_volume" :: held 1.617s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:00:56 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e7595502-59d1-4fa5-be8e-221e428aae1c tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "cinder-quobyte-d976605e-86c8-471f-8a20-bd718027e965" released by "delete_volume" :: held 1.372s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:00:56 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-e2e3b396-03f1-4778-b1f2-1e4ec71f6298 tempest-VolumeImageDependencyTests-301133217 None] Created reservations ['3b42b2e8-8bf2-4976-8b3d-f3115d2a1835', '06761c08-9f12-4b6f-b69f-44537efe01fe', 'e506258d-04e2-4a5f-9864-aaa2a90f01cc', '9a0d5c6d-6a1d-4b73-beef-36cdda765a5e'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:00:56 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-9ff2282e-f9f9-48ec-a1aa-d1be8f5da3ba tempest-CreateVolumesFromImageTest-1949445792 None] Created reservations ['5621d5c5-3f48-41d1-9293-48baf4a62530', 'be9b503c-0bfb-4cff-b524-e108e24f7918', '3bb8b211-8a89-49ec-adf2-59d6186c9be2', 'fd2db9fb-5c46-4793-8d82-ce989b3001b0'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:00:56 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-e7595502-59d1-4fa5-be8e-221e428aae1c tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Created reservations ['7fd6c281-6d2d-48a2-b49f-1df11ec778cb', 'fff79d0b-601e-4fd1-b6cd-087ea2d6ab23', 'a193eebd-afef-4513-a047-7e35e305468a', '586dda71-93bd-431c-ac02-fff12dd887bd'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:00:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e2e3b396-03f1-4778-b1f2-1e4ec71f6298 tempest-VolumeImageDependencyTests-301133217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e2e3b396-03f1-4778-b1f2-1e4ec71f6298 tempest-VolumeImageDependencyTests-301133217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:56 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e2e3b396-03f1-4778-b1f2-1e4ec71f6298 tempest-VolumeImageDependencyTests-301133217 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:00:56 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e2e3b396-03f1-4778-b1f2-1e4ec71f6298 tempest-VolumeImageDependencyTests-301133217 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:00:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e2e3b396-03f1-4778-b1f2-1e4ec71f6298 tempest-VolumeImageDependencyTests-301133217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e2e3b396-03f1-4778-b1f2-1e4ec71f6298 tempest-VolumeImageDependencyTests-301133217 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-9ff2282e-f9f9-48ec-a1aa-d1be8f5da3ba tempest-CreateVolumesFromImageTest-1949445792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-9ff2282e-f9f9-48ec-a1aa-d1be8f5da3ba tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:56 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-9ff2282e-f9f9-48ec-a1aa-d1be8f5da3ba tempest-CreateVolumesFromImageTest-1949445792 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:00:56 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-9ff2282e-f9f9-48ec-a1aa-d1be8f5da3ba tempest-CreateVolumesFromImageTest-1949445792 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:00:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-9ff2282e-f9f9-48ec-a1aa-d1be8f5da3ba tempest-CreateVolumesFromImageTest-1949445792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9ff2282e-f9f9-48ec-a1aa-d1be8f5da3ba tempest-CreateVolumesFromImageTest-1949445792 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e2e3b396-03f1-4778-b1f2-1e4ec71f6298 tempest-VolumeImageDependencyTests-301133217 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.479s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:57 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-e2e3b396-03f1-4778-b1f2-1e4ec71f6298 tempest-VolumeImageDependencyTests-301133217 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 16:00:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9ff2282e-f9f9-48ec-a1aa-d1be8f5da3ba tempest-CreateVolumesFromImageTest-1949445792 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.349s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:57 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-9ff2282e-f9f9-48ec-a1aa-d1be8f5da3ba tempest-CreateVolumesFromImageTest-1949445792 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 16:00:57 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-e2e3b396-03f1-4778-b1f2-1e4ec71f6298 tempest-VolumeImageDependencyTests-301133217 None] Deleted volume successfully. Sep 10 16:00:57 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-9ff2282e-f9f9-48ec-a1aa-d1be8f5da3ba tempest-CreateVolumesFromImageTest-1949445792 None] Deleted volume successfully. Sep 10 16:00:57 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e2e3b396-03f1-4778-b1f2-1e4ec71f6298 tempest-VolumeImageDependencyTests-301133217 None] Lock "cinder-07cd259f-5d33-4958-b680-395cc0827456-delete_volume" released by "delete_volume" :: held 3.485s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:00:57 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9ff2282e-f9f9-48ec-a1aa-d1be8f5da3ba tempest-CreateVolumesFromImageTest-1949445792 None] Lock "cinder-4a1df3fe-c997-4797-a10a-9b742b6de40d-delete_volume" released by "delete_volume" :: held 2.935s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:00:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e7595502-59d1-4fa5-be8e-221e428aae1c tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:00:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e7595502-59d1-4fa5-be8e-221e428aae1c tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:00:57 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e7595502-59d1-4fa5-be8e-221e428aae1c tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:00:57 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-e7595502-59d1-4fa5-be8e-221e428aae1c tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:00:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-e7595502-59d1-4fa5-be8e-221e428aae1c tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:00:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e7595502-59d1-4fa5-be8e-221e428aae1c tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-e7595502-59d1-4fa5-be8e-221e428aae1c tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.147s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:57 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-e7595502-59d1-4fa5-be8e-221e428aae1c tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 16:00:57 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-e7595502-59d1-4fa5-be8e-221e428aae1c tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Deleted volume successfully. Sep 10 16:00:57 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-e7595502-59d1-4fa5-be8e-221e428aae1c tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "cinder-d976605e-86c8-471f-8a20-bd718027e965-delete_volume" released by "delete_volume" :: held 3.270s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:00:57 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ea3155bb-fe9c-4707-834c-849803d546b3 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "cinder-39091d63-8e0e-4c1e-af1a-9849f4643111-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:00:57 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ea3155bb-fe9c-4707-834c-849803d546b3 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "cinder-39091d63-8e0e-4c1e-af1a-9849f4643111-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:00:57 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-ea3155bb-fe9c-4707-834c-849803d546b3 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:00:57 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ea3155bb-fe9c-4707-834c-849803d546b3 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "cinder-quobyte-39091d63-8e0e-4c1e-af1a-9849f4643111" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:00:57 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ea3155bb-fe9c-4707-834c-849803d546b3 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "cinder-quobyte-39091d63-8e0e-4c1e-af1a-9849f4643111" acquired by "delete_volume" :: waited 0.014s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:00:57 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddafec0-f105-4aae-91fb-aeaa0848a37a]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:00:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ea3155bb-fe9c-4707-834c-849803d546b3 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-39091d63-8e0e-4c1e-af1a-9849f4643111 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ea3155bb-fe9c-4707-834c-849803d546b3 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-39091d63-8e0e-4c1e-af1a-9849f4643111" returned: 0 in 0.711s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ea3155bb-fe9c-4707-834c-849803d546b3 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-39091d63-8e0e-4c1e-af1a-9849f4643111 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:00:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ea3155bb-fe9c-4707-834c-849803d546b3 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-39091d63-8e0e-4c1e-af1a-9849f4643111" returned: 0 in 0.206s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:00:59 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ea3155bb-fe9c-4707-834c-849803d546b3 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "cinder-quobyte-39091d63-8e0e-4c1e-af1a-9849f4643111" released by "delete_volume" :: held 1.292s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:01:00 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-ea3155bb-fe9c-4707-834c-849803d546b3 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Created reservations ['1d033533-780d-45d7-8c72-c392f07daee5', 'ed583c08-d840-46ea-a74b-28681f74631a', '04cedcd5-bfae-4e03-a61b-cb6ff5379b28', 'bb78f933-7ed7-4f98-954a-19077684d4af'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:01:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ea3155bb-fe9c-4707-834c-849803d546b3 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ea3155bb-fe9c-4707-834c-849803d546b3 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:00 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-ea3155bb-fe9c-4707-834c-849803d546b3 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:01:00 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-ea3155bb-fe9c-4707-834c-849803d546b3 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:01:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ea3155bb-fe9c-4707-834c-849803d546b3 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ea3155bb-fe9c-4707-834c-849803d546b3 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ea3155bb-fe9c-4707-834c-849803d546b3 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.111s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:00 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-ea3155bb-fe9c-4707-834c-849803d546b3 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 16:01:00 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-ea3155bb-fe9c-4707-834c-849803d546b3 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Deleted volume successfully. Sep 10 16:01:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-ea3155bb-fe9c-4707-834c-849803d546b3 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "cinder-39091d63-8e0e-4c1e-af1a-9849f4643111-delete_volume" released by "delete_volume" :: held 3.337s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:01:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d378defb-7d44-4e03-b8e6-65f740228203 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "cinder-8677c651-e061-4492-b65b-678c760c4e15-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d378defb-7d44-4e03-b8e6-65f740228203 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "cinder-8677c651-e061-4492-b65b-678c760c4e15-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:01 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-d378defb-7d44-4e03-b8e6-65f740228203 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:01:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d378defb-7d44-4e03-b8e6-65f740228203 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "cinder-quobyte-8677c651-e061-4492-b65b-678c760c4e15" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d378defb-7d44-4e03-b8e6-65f740228203 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "cinder-quobyte-8677c651-e061-4492-b65b-678c760c4e15" acquired by "delete_volume" :: waited 0.015s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:01 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9faddc-70b7-499e-a2c0-8216432a34ef]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:01:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d378defb-7d44-4e03-b8e6-65f740228203 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8677c651-e061-4492-b65b-678c760c4e15 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d378defb-7d44-4e03-b8e6-65f740228203 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8677c651-e061-4492-b65b-678c760c4e15" returned: 0 in 0.513s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d378defb-7d44-4e03-b8e6-65f740228203 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8677c651-e061-4492-b65b-678c760c4e15 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d378defb-7d44-4e03-b8e6-65f740228203 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-8677c651-e061-4492-b65b-678c760c4e15" returned: 0 in 0.132s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:02 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d378defb-7d44-4e03-b8e6-65f740228203 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "cinder-quobyte-8677c651-e061-4492-b65b-678c760c4e15" released by "delete_volume" :: held 0.852s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:01:02 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-d378defb-7d44-4e03-b8e6-65f740228203 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Created reservations ['b64bdbd3-1a19-48e7-bd1f-4fac464c9f21', 'ac78bc3a-4d07-4274-a27f-57988e1b8d89', '9c60426b-3c2d-4c92-9c28-32bde0a0d3ff', '9f717325-d897-48cb-ab76-bdef4b1325f1'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d378defb-7d44-4e03-b8e6-65f740228203 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d378defb-7d44-4e03-b8e6-65f740228203 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d378defb-7d44-4e03-b8e6-65f740228203 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-d378defb-7d44-4e03-b8e6-65f740228203 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-d378defb-7d44-4e03-b8e6-65f740228203 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d378defb-7d44-4e03-b8e6-65f740228203 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-d378defb-7d44-4e03-b8e6-65f740228203 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.106s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-d378defb-7d44-4e03-b8e6-65f740228203 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 16:01:03 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-d378defb-7d44-4e03-b8e6-65f740228203 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Deleted volume successfully. Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-d378defb-7d44-4e03-b8e6-65f740228203 tempest-CreateVolumesFromSourceVolumeTest-1858238762 None] Lock "cinder-8677c651-e061-4492-b65b-678c760c4e15-delete_volume" released by "delete_volume" :: held 2.012s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:01:03 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Flow 'volume_create_manager' (56a3984c-a94a-4b7e-acf9-2b7d4d9b3d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a87cc2c-e9b4-43fa-b67f-d3a8513d46fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a87cc2c-e9b4-43fa-b67f-d3a8513d46fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1658839289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b31712-4501-48b8-8fab-45d1ab254768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc306682a141416d9e82919b341e32c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:01:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:01:03Z,use_quota=True,user_id='08d3e69bf7a84077947b88a29564fb8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f66cb66-8e8f-4f10-822a-800d4fc9702a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f66cb66-8e8f-4f10-822a-800d4fc9702a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67b6f5df-d30d-4e50-8b25-2869f3f3541d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67b6f5df-d30d-4e50-8b25-2869f3f3541d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48b31712-4501-48b8-8fab-45d1ab254768', 'volume_name': 'volume-48b31712-4501-48b8-8fab-45d1ab254768', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a29fb5aa-f527-42c4-8432-9fc67cb8c49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a29fb5aa-f527-42c4-8432-9fc67cb8c49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f10edfe-82ce-4d79-a513-e9e2246698b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:03 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume 48b31712-4501-48b8-8fab-45d1ab254768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48b31712-4501-48b8-8fab-45d1ab254768', 'volume_size': 1} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1658839289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b31712-4501-48b8-8fab-45d1ab254768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc306682a141416d9e82919b341e32c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:01:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:01:03Z,use_quota=True,user_id='08d3e69bf7a84077947b88a29564fb8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Creating volume 48b31712-4501-48b8-8fab-45d1ab254768 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 16:01:03 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 16:01:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:03 devstack quobyte-client[82814]: System call of process 100650 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 16:01:03 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=158, name=volume-48b31712-4501-48b8-8fab-45d1ab254768, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 16:01:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768 1073741824" returned: 0 in 0.393s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768" returned: 0 in 0.093s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:04 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] <== create_volume: return (562ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 16:01:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.577s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:04 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f10edfe-82ce-4d79-a513-e9e2246698b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48b31712-4501-48b8-8fab-45d1ab254768', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:04 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c58ae17-7482-4df7-9cce-fab45ba4a9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:04 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume volume-48b31712-4501-48b8-8fab-45d1ab254768 (48b31712-4501-48b8-8fab-45d1ab254768): created successfully Sep 10 16:01:04 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c58ae17-7482-4df7-9cce-fab45ba4a9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:04 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Flow 'volume_create_manager' (56a3984c-a94a-4b7e-acf9-2b7d4d9b3d41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:01:04 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-63914fdf-27bb-4661-bc96-1fafa1854df0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Created volume successfully. Sep 10 16:01:06 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-458e0d7d-2d24-44c2-98e0-9e98912e0fde tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:01:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-458e0d7d-2d24-44c2-98e0-9e98912e0fde tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-458e0d7d-2d24-44c2-98e0-9e98912e0fde tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:06 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-458e0d7d-2d24-44c2-98e0-9e98912e0fde tempest-CreateVolumesFromSnapshotTest-1666577027 None] Creating offline snapshot 33e8af29-6e5b-4e42-89ea-262df54c22c6 of volume 48b31712-4501-48b8-8fab-45d1ab254768 {{(pid=82800) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 16:01:06 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[882d1ceb-a8f0-4471-93d4-63f229756eac]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:01:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-458e0d7d-2d24-44c2-98e0-9e98912e0fde tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-458e0d7d-2d24-44c2-98e0-9e98912e0fde tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768" returned: 0 in 0.486s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-458e0d7d-2d24-44c2-98e0-9e98912e0fde tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768.33e8af29-6e5b-4e42-89ea-262df54c22c6 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:06 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=159, name=volume-48b31712-4501-48b8-8fab-45d1ab254768.33e8af29-6e5b-4e42-89ea-262df54c22c6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 16:01:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-458e0d7d-2d24-44c2-98e0-9e98912e0fde tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768.33e8af29-6e5b-4e42-89ea-262df54c22c6 1G" returned: 0 in 0.282s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:06 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-458e0d7d-2d24-44c2-98e0-9e98912e0fde tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): qemu-img rebase -u -b volume-48b31712-4501-48b8-8fab-45d1ab254768 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768.33e8af29-6e5b-4e42-89ea-262df54c22c6 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-458e0d7d-2d24-44c2-98e0-9e98912e0fde tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "qemu-img rebase -u -b volume-48b31712-4501-48b8-8fab-45d1ab254768 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768.33e8af29-6e5b-4e42-89ea-262df54c22c6" returned: 0 in 0.162s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:07 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-458e0d7d-2d24-44c2-98e0-9e98912e0fde tempest-CreateVolumesFromSnapshotTest-1666577027 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768.33e8af29-6e5b-4e42-89ea-262df54c22c6 is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 16:01:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-458e0d7d-2d24-44c2-98e0-9e98912e0fde tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768.33e8af29-6e5b-4e42-89ea-262df54c22c6 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-458e0d7d-2d24-44c2-98e0-9e98912e0fde tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768.33e8af29-6e5b-4e42-89ea-262df54c22c6" returned: 0 in 0.098s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:07 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-458e0d7d-2d24-44c2-98e0-9e98912e0fde tempest-CreateVolumesFromSnapshotTest-1666577027 None] Setting permissions: /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768 -> 1000:1000 {{(pid=82800) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 16:01:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-458e0d7d-2d24-44c2-98e0-9e98912e0fde tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768.33e8af29-6e5b-4e42-89ea-262df54c22c6 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-458e0d7d-2d24-44c2-98e0-9e98912e0fde tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768.33e8af29-6e5b-4e42-89ea-262df54c22c6" returned: 0 in 0.102s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-458e0d7d-2d24-44c2-98e0-9e98912e0fde tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-458e0d7d-2d24-44c2-98e0-9e98912e0fde tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768.info" returned: 0 in 0.135s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:07 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-458e0d7d-2d24-44c2-98e0-9e98912e0fde tempest-CreateVolumesFromSnapshotTest-1666577027 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768.info is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 16:01:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-458e0d7d-2d24-44c2-98e0-9e98912e0fde tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-458e0d7d-2d24-44c2-98e0-9e98912e0fde tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768.info" returned: 0 in 0.100s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:07 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-458e0d7d-2d24-44c2-98e0-9e98912e0fde tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.775s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:08 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-458e0d7d-2d24-44c2-98e0-9e98912e0fde tempest-CreateVolumesFromSnapshotTest-1666577027 None] Create snapshot completed successfully Sep 10 16:01:09 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:01:09 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 16:01:09 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Flow 'volume_create_manager' (1640d3ae-d967-43ae-bfc7-978f308e1470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:01:09 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d60794-17c9-468b-b531-f9c7a129dc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:09 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80d60794-17c9-468b-b531-f9c7a129dc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1006521583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc81dd01-2114-4a68-8119-8a2fad9fbbb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc306682a141416d9e82919b341e32c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:01:09Z,use_quota=True,user_id='08d3e69bf7a84077947b88a29564fb8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:09 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8defc8be-a67b-43e9-acab-b9825d627f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:09 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8defc8be-a67b-43e9-acab-b9825d627f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:09 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f36b2eda-8f2b-473c-adab-6891d34d65c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:09 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f36b2eda-8f2b-473c-adab-6891d34d65c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc81dd01-2114-4a68-8119-8a2fad9fbbb1', 'volume_name': 'volume-bc81dd01-2114-4a68-8119-8a2fad9fbbb1', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:09 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff880a84-6d7e-45ab-9e09-865379fee349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:09 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff880a84-6d7e-45ab-9e09-865379fee349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:09 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09560ca8-5b6d-4d80-97de-2eb6668c3494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:09 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume bc81dd01-2114-4a68-8119-8a2fad9fbbb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc81dd01-2114-4a68-8119-8a2fad9fbbb1', 'volume_size': 1} Sep 10 16:01:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:09 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1006521583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc81dd01-2114-4a68-8119-8a2fad9fbbb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc306682a141416d9e82919b341e32c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:01:09Z,use_quota=True,user_id='08d3e69bf7a84077947b88a29564fb8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 16:01:09 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Creating volume bc81dd01-2114-4a68-8119-8a2fad9fbbb1 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 16:01:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:09 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:01:09 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:01:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:09 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 16:01:09 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 16:01:09 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bc81dd01-2114-4a68-8119-8a2fad9fbbb1 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:10 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=161, name=volume-bc81dd01-2114-4a68-8119-8a2fad9fbbb1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 16:01:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bc81dd01-2114-4a68-8119-8a2fad9fbbb1 1073741824" returned: 0 in 0.844s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:10 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bc81dd01-2114-4a68-8119-8a2fad9fbbb1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:10 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:01:10 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Flow 'volume_create_manager' (05fd8512-640c-4f96-a48b-ea47daf6e4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5519533d-70b1-4568-af9a-1df044477d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:11 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Flow 'volume_create_manager' (5ea8acc8-8cb2-490c-9d67-77fd4c2c6ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c88b1d-efa1-4559-b3e4-f0088d0a1874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5519533d-70b1-4568-af9a-1df044477d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1546740388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f1e23d9-461d-45c6-a866-e89c09226169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc306682a141416d9e82919b341e32c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:01:10Z,use_quota=True,user_id='08d3e69bf7a84077947b88a29564fb8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54a4258-7043-4666-a848-f337fdd4cb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54a4258-7043-4666-a848-f337fdd4cb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce80bd2c-d712-4fad-ada2-0cdb9585c129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce80bd2c-d712-4fad-ada2-0cdb9585c129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f1e23d9-461d-45c6-a866-e89c09226169', 'volume_name': 'volume-6f1e23d9-461d-45c6-a866-e89c09226169', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (477a41d5-8ff5-4cb9-bda4-ce855e6a43ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (477a41d5-8ff5-4cb9-bda4-ce855e6a43ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c9e274a-ac6f-428b-b561-8892b8acfe6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:11 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume 6f1e23d9-461d-45c6-a866-e89c09226169: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f1e23d9-461d-45c6-a866-e89c09226169', 'volume_size': 1} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bc81dd01-2114-4a68-8119-8a2fad9fbbb1" returned: 0 in 0.751s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] <== create_volume: return (1634ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.039s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1546740388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f1e23d9-461d-45c6-a866-e89c09226169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc306682a141416d9e82919b341e32c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:01:10Z,use_quota=True,user_id='08d3e69bf7a84077947b88a29564fb8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Creating volume 6f1e23d9-461d-45c6-a866-e89c09226169 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 16:01:11 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6f1e23d9-461d-45c6-a866-e89c09226169 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:11 devstack quobyte-client[82814]: System call of process 100672 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 16:01:11 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=162, name=volume-6f1e23d9-461d-45c6-a866-e89c09226169, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c88b1d-efa1-4559-b3e4-f0088d0a1874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1917212779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30541711-1d53-4d40-a84f-d11f3409c7b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc306682a141416d9e82919b341e32c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:01:11Z,use_quota=True,user_id='08d3e69bf7a84077947b88a29564fb8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cae83ad-e695-4751-bde3-6f4a12665fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cae83ad-e695-4751-bde3-6f4a12665fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0da317-d809-484e-9225-a998bc212a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0da317-d809-484e-9225-a998bc212a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30541711-1d53-4d40-a84f-d11f3409c7b0', 'volume_name': 'volume-30541711-1d53-4d40-a84f-d11f3409c7b0', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4eadc1-2e69-4015-88cd-e2deee3117ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4eadc1-2e69-4015-88cd-e2deee3117ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:11 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ddb1b0e-c2a7-467c-ac0c-475f216c0ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:11 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume 30541711-1d53-4d40-a84f-d11f3409c7b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30541711-1d53-4d40-a84f-d11f3409c7b0', 'volume_size': 1} Sep 10 16:01:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:12 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09560ca8-5b6d-4d80-97de-2eb6668c3494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc81dd01-2114-4a68-8119-8a2fad9fbbb1', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:12 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (560947c4-4f24-4c8a-8efc-d854eef9db06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:12 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:01:12 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 16:01:12 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Flow 'volume_create_manager' (27267314-c4c6-4d35-b1af-b1a397eed174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:01:12 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (170a693a-48be-4b87-9f3b-cbd7d1b7f64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:12 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume volume-bc81dd01-2114-4a68-8119-8a2fad9fbbb1 (bc81dd01-2114-4a68-8119-8a2fad9fbbb1): created successfully Sep 10 16:01:12 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (560947c4-4f24-4c8a-8efc-d854eef9db06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:12 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Flow 'volume_create_manager' (1640d3ae-d967-43ae-bfc7-978f308e1470) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:01:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6f1e23d9-461d-45c6-a866-e89c09226169 1073741824" returned: 0 in 0.982s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:12 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (170a693a-48be-4b87-9f3b-cbd7d1b7f64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1533819266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371e9eb6-1e57-457a-987b-a67df8bd8b7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc306682a141416d9e82919b341e32c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:01:11Z,use_quota=True,user_id='08d3e69bf7a84077947b88a29564fb8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:12 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8942e773-0d11-47a0-a917-802ecdb3ba86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:12 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8942e773-0d11-47a0-a917-802ecdb3ba86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:12 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc8c1cd-80b4-4c2e-b18d-70e5d79781fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:12 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc8c1cd-80b4-4c2e-b18d-70e5d79781fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '371e9eb6-1e57-457a-987b-a67df8bd8b7c', 'volume_name': 'volume-371e9eb6-1e57-457a-987b-a67df8bd8b7c', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:12 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4852c9b5-94e1-4ffd-9e6c-f5fe2d7fb96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:12 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4852c9b5-94e1-4ffd-9e6c-f5fe2d7fb96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:12 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4c08ba-8e5e-4695-8b5d-b0ee1578d063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:12 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume 371e9eb6-1e57-457a-987b-a67df8bd8b7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-371e9eb6-1e57-457a-987b-a67df8bd8b7c', 'volume_size': 1} Sep 10 16:01:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:12 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:01:12 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 16:01:12 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Flow 'volume_create_manager' (2c0b2d67-d82d-4f1d-b178-bf6fbfb94686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:01:12 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fdc04f2-eb99-4621-be56-b44e96ae9c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:12 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6f1e23d9-461d-45c6-a866-e89c09226169 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fdc04f2-eb99-4621-be56-b44e96ae9c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-910291489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba73f73-b8ea-4525-8cad-0a8b22b24ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc306682a141416d9e82919b341e32c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:01:12Z,use_quota=True,user_id='08d3e69bf7a84077947b88a29564fb8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffd104f3-9c19-4bd7-b5b1-0e3e3778bdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffd104f3-9c19-4bd7-b5b1-0e3e3778bdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e08d54d-7616-4144-a97f-555bb0767adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e08d54d-7616-4144-a97f-555bb0767adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fba73f73-b8ea-4525-8cad-0a8b22b24ba9', 'volume_name': 'volume-fba73f73-b8ea-4525-8cad-0a8b22b24ba9', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06bf011-a2af-4dc5-a00e-39ab119d72a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06bf011-a2af-4dc5-a00e-39ab119d72a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e9a6ea-940d-4784-ba8e-20ad84db826f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:13 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume fba73f73-b8ea-4525-8cad-0a8b22b24ba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fba73f73-b8ea-4525-8cad-0a8b22b24ba9', 'volume_size': 1} Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:13 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-13cf340c-0a9e-44dc-970e-cffa801ce022 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Created volume successfully. Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6f1e23d9-461d-45c6-a866-e89c09226169" returned: 0 in 0.477s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] <== create_volume: return (1647ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.220s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1917212779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30541711-1d53-4d40-a84f-d11f3409c7b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc306682a141416d9e82919b341e32c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:01:11Z,use_quota=True,user_id='08d3e69bf7a84077947b88a29564fb8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Creating volume 30541711-1d53-4d40-a84f-d11f3409c7b0 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 16:01:13 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-30541711-1d53-4d40-a84f-d11f3409c7b0 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:13 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=163, name=volume-30541711-1d53-4d40-a84f-d11f3409c7b0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c9e274a-ac6f-428b-b561-8892b8acfe6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f1e23d9-461d-45c6-a866-e89c09226169', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9215892c-0d70-4bce-a8ad-d627ac0d407d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:13 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume volume-6f1e23d9-461d-45c6-a866-e89c09226169 (6f1e23d9-461d-45c6-a866-e89c09226169): created successfully Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9215892c-0d70-4bce-a8ad-d627ac0d407d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Flow 'volume_create_manager' (05fd8512-640c-4f96-a48b-ea47daf6e4ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-30541711-1d53-4d40-a84f-d11f3409c7b0 1073741824" returned: 0 in 0.466s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:13 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-30541711-1d53-4d40-a84f-d11f3409c7b0 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:13 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-cb0fc938-5a69-445f-9b8b-608d64145854 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Created volume successfully. Sep 10 16:01:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-30541711-1d53-4d40-a84f-d11f3409c7b0" returned: 0 in 0.294s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:14 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] <== create_volume: return (782ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 16:01:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.423s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:14 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1533819266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371e9eb6-1e57-457a-987b-a67df8bd8b7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc306682a141416d9e82919b341e32c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:01:11Z,use_quota=True,user_id='08d3e69bf7a84077947b88a29564fb8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 16:01:14 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Creating volume 371e9eb6-1e57-457a-987b-a67df8bd8b7c {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 16:01:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:14 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:01:14 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:01:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:14 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 16:01:14 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 16:01:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-371e9eb6-1e57-457a-987b-a67df8bd8b7c 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:14 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ddb1b0e-c2a7-467c-ac0c-475f216c0ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30541711-1d53-4d40-a84f-d11f3409c7b0', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:14 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e05ba7-d5e1-4e1b-8110-6b0d1fe43a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:14 devstack quobyte-client[82814]: System call of process 100686 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 16:01:14 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=164, name=volume-371e9eb6-1e57-457a-987b-a67df8bd8b7c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 16:01:14 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume volume-30541711-1d53-4d40-a84f-d11f3409c7b0 (30541711-1d53-4d40-a84f-d11f3409c7b0): created successfully Sep 10 16:01:14 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e05ba7-d5e1-4e1b-8110-6b0d1fe43a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:14 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Flow 'volume_create_manager' (5ea8acc8-8cb2-490c-9d67-77fd4c2c6ecf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:01:14 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-edb13b0c-6e1d-4ac3-a36a-37a9aa3a431b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Created volume successfully. Sep 10 16:01:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-371e9eb6-1e57-457a-987b-a67df8bd8b7c 1073741824" returned: 0 in 0.676s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-371e9eb6-1e57-457a-987b-a67df8bd8b7c {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:14 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-371e9eb6-1e57-457a-987b-a67df8bd8b7c" returned: 0 in 0.163s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:14 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] <== create_volume: return (929ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 16:01:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.087s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:15 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-910291489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba73f73-b8ea-4525-8cad-0a8b22b24ba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc306682a141416d9e82919b341e32c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:01:12Z,use_quota=True,user_id='08d3e69bf7a84077947b88a29564fb8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 16:01:15 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Creating volume fba73f73-b8ea-4525-8cad-0a8b22b24ba9 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 16:01:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:15 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:01:15 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:01:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:15 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 16:01:15 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 16:01:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-fba73f73-b8ea-4525-8cad-0a8b22b24ba9 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:15 devstack quobyte-client[82814]: System call of process 100691 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 16:01:15 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=165, name=volume-fba73f73-b8ea-4525-8cad-0a8b22b24ba9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 16:01:15 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4c08ba-8e5e-4695-8b5d-b0ee1578d063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-371e9eb6-1e57-457a-987b-a67df8bd8b7c', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:15 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfceb73d-4c51-47f8-aba6-fb4eac320206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:15 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume volume-371e9eb6-1e57-457a-987b-a67df8bd8b7c (371e9eb6-1e57-457a-987b-a67df8bd8b7c): created successfully Sep 10 16:01:15 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfceb73d-4c51-47f8-aba6-fb4eac320206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:15 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Flow 'volume_create_manager' (27267314-c4c6-4d35-b1af-b1a397eed174) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:01:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-fba73f73-b8ea-4525-8cad-0a8b22b24ba9 1073741824" returned: 0 in 0.661s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:15 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-fba73f73-b8ea-4525-8cad-0a8b22b24ba9 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:16 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-87a66177-1f11-4823-a192-217b13c801e5 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Created volume successfully. Sep 10 16:01:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-fba73f73-b8ea-4525-8cad-0a8b22b24ba9" returned: 0 in 0.303s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:16 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] <== create_volume: return (1004ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 16:01:16 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e9a6ea-940d-4784-ba8e-20ad84db826f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fba73f73-b8ea-4525-8cad-0a8b22b24ba9', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0596ebe7-4293-441d-8612-d0ba31d5b6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:16 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume volume-fba73f73-b8ea-4525-8cad-0a8b22b24ba9 (fba73f73-b8ea-4525-8cad-0a8b22b24ba9): created successfully Sep 10 16:01:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0596ebe7-4293-441d-8612-d0ba31d5b6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:16 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Flow 'volume_create_manager' (2c0b2d67-d82d-4f1d-b178-bf6fbfb94686) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:01:16 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-f7b17647-644a-444f-bb83-040dddbd99ad tempest-CreateVolumesFromSnapshotTest-1666577027 None] Created volume successfully. Sep 10 16:01:17 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-5071ec86-ea45-45ea-9361-d82d1122827b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "cinder-fba73f73-b8ea-4525-8cad-0a8b22b24ba9-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:17 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-5071ec86-ea45-45ea-9361-d82d1122827b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-fba73f73-b8ea-4525-8cad-0a8b22b24ba9-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:17 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=84,cinder:UPDATE=137,cinder:DELETE=13,cinder:INSERT=30 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 16:01:17 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-5071ec86-ea45-45ea-9361-d82d1122827b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:01:17 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-5071ec86-ea45-45ea-9361-d82d1122827b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "cinder-quobyte-fba73f73-b8ea-4525-8cad-0a8b22b24ba9" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:17 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-5071ec86-ea45-45ea-9361-d82d1122827b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-quobyte-fba73f73-b8ea-4525-8cad-0a8b22b24ba9" acquired by "delete_volume" :: waited 0.013s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:17 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d19110-3264-415a-bb16-0668f170e206]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:01:17 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5071ec86-ea45-45ea-9361-d82d1122827b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-fba73f73-b8ea-4525-8cad-0a8b22b24ba9 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5071ec86-ea45-45ea-9361-d82d1122827b tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-fba73f73-b8ea-4525-8cad-0a8b22b24ba9" returned: 0 in 0.595s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5071ec86-ea45-45ea-9361-d82d1122827b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-fba73f73-b8ea-4525-8cad-0a8b22b24ba9 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5071ec86-ea45-45ea-9361-d82d1122827b tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-fba73f73-b8ea-4525-8cad-0a8b22b24ba9" returned: 0 in 0.122s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:18 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-5071ec86-ea45-45ea-9361-d82d1122827b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-quobyte-fba73f73-b8ea-4525-8cad-0a8b22b24ba9" released by "delete_volume" :: held 0.947s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:01:18 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=90,cinder:UPDATE=134,cinder:DELETE=18,cinder:INSERT=27 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 16:01:18 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-5071ec86-ea45-45ea-9361-d82d1122827b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Created reservations ['6b93f30d-f25d-42c5-9ca1-6c57e0e4195e', 'f07169ac-2cfd-4398-b878-747a5681fed6', '6a850df3-6e8f-4beb-a67e-8d1edde396f0', '3398def6-0438-4e6c-b2a6-d1d80dedeab1'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:01:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-5071ec86-ea45-45ea-9361-d82d1122827b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-5071ec86-ea45-45ea-9361-d82d1122827b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:18 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-5071ec86-ea45-45ea-9361-d82d1122827b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:01:18 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-5071ec86-ea45-45ea-9361-d82d1122827b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:01:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-5071ec86-ea45-45ea-9361-d82d1122827b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:18 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5071ec86-ea45-45ea-9361-d82d1122827b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5071ec86-ea45-45ea-9361-d82d1122827b tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.149s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:19 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-5071ec86-ea45-45ea-9361-d82d1122827b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 16:01:19 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-5071ec86-ea45-45ea-9361-d82d1122827b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Deleted volume successfully. Sep 10 16:01:19 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-5071ec86-ea45-45ea-9361-d82d1122827b tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-fba73f73-b8ea-4525-8cad-0a8b22b24ba9-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:01:19 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9a98c685-cc7f-4cdf-b9a1-646a9e054403 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "cinder-371e9eb6-1e57-457a-987b-a67df8bd8b7c-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:19 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9a98c685-cc7f-4cdf-b9a1-646a9e054403 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-371e9eb6-1e57-457a-987b-a67df8bd8b7c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:19 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-9a98c685-cc7f-4cdf-b9a1-646a9e054403 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:01:19 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9a98c685-cc7f-4cdf-b9a1-646a9e054403 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "cinder-quobyte-371e9eb6-1e57-457a-987b-a67df8bd8b7c" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:19 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9a98c685-cc7f-4cdf-b9a1-646a9e054403 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-quobyte-371e9eb6-1e57-457a-987b-a67df8bd8b7c" acquired by "delete_volume" :: waited 0.015s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:19 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f8279d-a925-4617-a36c-0304c8022ed5]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:01:19 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9a98c685-cc7f-4cdf-b9a1-646a9e054403 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-371e9eb6-1e57-457a-987b-a67df8bd8b7c {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9a98c685-cc7f-4cdf-b9a1-646a9e054403 tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-371e9eb6-1e57-457a-987b-a67df8bd8b7c" returned: 0 in 0.482s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9a98c685-cc7f-4cdf-b9a1-646a9e054403 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-371e9eb6-1e57-457a-987b-a67df8bd8b7c {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:20 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9a98c685-cc7f-4cdf-b9a1-646a9e054403 tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-371e9eb6-1e57-457a-987b-a67df8bd8b7c" returned: 0 in 0.131s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:20 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9a98c685-cc7f-4cdf-b9a1-646a9e054403 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-quobyte-371e9eb6-1e57-457a-987b-a67df8bd8b7c" released by "delete_volume" :: held 0.816s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:01:21 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-9a98c685-cc7f-4cdf-b9a1-646a9e054403 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Created reservations ['ae0cac1f-7604-4c8e-9387-240a05644fb2', 'bf5643da-1d4f-4ca0-8ec8-536ed2da06c3', 'caf326ad-c10e-428d-9924-08b73f626b7e', '65a150a8-9db2-4665-a02d-3c830e274978'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:01:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-9a98c685-cc7f-4cdf-b9a1-646a9e054403 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-9a98c685-cc7f-4cdf-b9a1-646a9e054403 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-9a98c685-cc7f-4cdf-b9a1-646a9e054403 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:01:21 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-9a98c685-cc7f-4cdf-b9a1-646a9e054403 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:01:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-9a98c685-cc7f-4cdf-b9a1-646a9e054403 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9a98c685-cc7f-4cdf-b9a1-646a9e054403 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:21 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-9a98c685-cc7f-4cdf-b9a1-646a9e054403 tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.101s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:21 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-9a98c685-cc7f-4cdf-b9a1-646a9e054403 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 16:01:21 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-9a98c685-cc7f-4cdf-b9a1-646a9e054403 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Deleted volume successfully. Sep 10 16:01:21 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-9a98c685-cc7f-4cdf-b9a1-646a9e054403 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-371e9eb6-1e57-457a-987b-a67df8bd8b7c-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:01:22 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-3058050a-d210-4c8e-8eb4-b9ab390b4a4c tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "cinder-30541711-1d53-4d40-a84f-d11f3409c7b0-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:22 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-3058050a-d210-4c8e-8eb4-b9ab390b4a4c tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-30541711-1d53-4d40-a84f-d11f3409c7b0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:22 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-3058050a-d210-4c8e-8eb4-b9ab390b4a4c tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:01:22 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-3058050a-d210-4c8e-8eb4-b9ab390b4a4c tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "cinder-quobyte-30541711-1d53-4d40-a84f-d11f3409c7b0" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:22 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-3058050a-d210-4c8e-8eb4-b9ab390b4a4c tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-quobyte-30541711-1d53-4d40-a84f-d11f3409c7b0" acquired by "delete_volume" :: waited 0.012s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:22 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e16ae6-166b-4a75-8971-3d08c67b38f8]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:01:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3058050a-d210-4c8e-8eb4-b9ab390b4a4c tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-30541711-1d53-4d40-a84f-d11f3409c7b0 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3058050a-d210-4c8e-8eb4-b9ab390b4a4c tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-30541711-1d53-4d40-a84f-d11f3409c7b0" returned: 0 in 0.571s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:22 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3058050a-d210-4c8e-8eb4-b9ab390b4a4c tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-30541711-1d53-4d40-a84f-d11f3409c7b0 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3058050a-d210-4c8e-8eb4-b9ab390b4a4c tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-30541711-1d53-4d40-a84f-d11f3409c7b0" returned: 0 in 0.107s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:23 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-3058050a-d210-4c8e-8eb4-b9ab390b4a4c tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-quobyte-30541711-1d53-4d40-a84f-d11f3409c7b0" released by "delete_volume" :: held 0.847s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:01:23 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-3058050a-d210-4c8e-8eb4-b9ab390b4a4c tempest-CreateVolumesFromSnapshotTest-1666577027 None] Created reservations ['2c6eb0e8-64ee-4c0e-b92e-99072092a1c5', '9d9dfb32-269b-451e-b104-6c97aecf3031', '201242c2-0d9b-43f9-8f02-704cc2506589', '8510ad66-c5c6-4a37-be83-ca217c2bba9f'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:01:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-3058050a-d210-4c8e-8eb4-b9ab390b4a4c tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-3058050a-d210-4c8e-8eb4-b9ab390b4a4c tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:23 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-3058050a-d210-4c8e-8eb4-b9ab390b4a4c tempest-CreateVolumesFromSnapshotTest-1666577027 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:01:23 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-3058050a-d210-4c8e-8eb4-b9ab390b4a4c tempest-CreateVolumesFromSnapshotTest-1666577027 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:01:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-3058050a-d210-4c8e-8eb4-b9ab390b4a4c tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3058050a-d210-4c8e-8eb4-b9ab390b4a4c tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:23 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-3058050a-d210-4c8e-8eb4-b9ab390b4a4c tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.097s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:23 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-3058050a-d210-4c8e-8eb4-b9ab390b4a4c tempest-CreateVolumesFromSnapshotTest-1666577027 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 16:01:23 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-3058050a-d210-4c8e-8eb4-b9ab390b4a4c tempest-CreateVolumesFromSnapshotTest-1666577027 None] Deleted volume successfully. Sep 10 16:01:24 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-3058050a-d210-4c8e-8eb4-b9ab390b4a4c tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-30541711-1d53-4d40-a84f-d11f3409c7b0-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:01:24 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-815f5b2f-0ca4-408f-a2fd-12f9fadb7bf0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "cinder-6f1e23d9-461d-45c6-a866-e89c09226169-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:24 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-815f5b2f-0ca4-408f-a2fd-12f9fadb7bf0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-6f1e23d9-461d-45c6-a866-e89c09226169-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:24 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-815f5b2f-0ca4-408f-a2fd-12f9fadb7bf0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:01:24 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-815f5b2f-0ca4-408f-a2fd-12f9fadb7bf0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "cinder-quobyte-6f1e23d9-461d-45c6-a866-e89c09226169" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:24 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-815f5b2f-0ca4-408f-a2fd-12f9fadb7bf0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-quobyte-6f1e23d9-461d-45c6-a866-e89c09226169" acquired by "delete_volume" :: waited 0.011s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:24 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0c1f78-bae7-4da5-a38b-c63e32dcaf31]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:01:24 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-815f5b2f-0ca4-408f-a2fd-12f9fadb7bf0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6f1e23d9-461d-45c6-a866-e89c09226169 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-815f5b2f-0ca4-408f-a2fd-12f9fadb7bf0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6f1e23d9-461d-45c6-a866-e89c09226169" returned: 0 in 0.494s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-815f5b2f-0ca4-408f-a2fd-12f9fadb7bf0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6f1e23d9-461d-45c6-a866-e89c09226169 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:25 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-815f5b2f-0ca4-408f-a2fd-12f9fadb7bf0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6f1e23d9-461d-45c6-a866-e89c09226169" returned: 0 in 0.127s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:25 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-815f5b2f-0ca4-408f-a2fd-12f9fadb7bf0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-quobyte-6f1e23d9-461d-45c6-a866-e89c09226169" released by "delete_volume" :: held 0.797s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:01:25 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-815f5b2f-0ca4-408f-a2fd-12f9fadb7bf0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Created reservations ['78f24dc0-b733-4db1-96a3-d252f16c8926', 'acd25ce9-f90e-4071-bab5-61a6b1cbef24', 'f9d1db1f-fa4c-4709-8d7c-5f5a31135bc2', '97602b62-4548-44e6-8144-be3961a0c819'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:01:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-815f5b2f-0ca4-408f-a2fd-12f9fadb7bf0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-815f5b2f-0ca4-408f-a2fd-12f9fadb7bf0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-815f5b2f-0ca4-408f-a2fd-12f9fadb7bf0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:01:26 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-815f5b2f-0ca4-408f-a2fd-12f9fadb7bf0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:01:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-815f5b2f-0ca4-408f-a2fd-12f9fadb7bf0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-815f5b2f-0ca4-408f-a2fd-12f9fadb7bf0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:26 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-815f5b2f-0ca4-408f-a2fd-12f9fadb7bf0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.163s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:26 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-815f5b2f-0ca4-408f-a2fd-12f9fadb7bf0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 16:01:26 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-815f5b2f-0ca4-408f-a2fd-12f9fadb7bf0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Deleted volume successfully. Sep 10 16:01:26 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-815f5b2f-0ca4-408f-a2fd-12f9fadb7bf0 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-6f1e23d9-461d-45c6-a866-e89c09226169-delete_volume" released by "delete_volume" :: held 2.204s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:01:27 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-695dffb1-d842-4996-bae0-622dbf3ad49a tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "cinder-bc81dd01-2114-4a68-8119-8a2fad9fbbb1-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:27 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-695dffb1-d842-4996-bae0-622dbf3ad49a tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-bc81dd01-2114-4a68-8119-8a2fad9fbbb1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:27 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-695dffb1-d842-4996-bae0-622dbf3ad49a tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:01:27 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-695dffb1-d842-4996-bae0-622dbf3ad49a tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "cinder-quobyte-bc81dd01-2114-4a68-8119-8a2fad9fbbb1" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:27 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-695dffb1-d842-4996-bae0-622dbf3ad49a tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-quobyte-bc81dd01-2114-4a68-8119-8a2fad9fbbb1" acquired by "delete_volume" :: waited 0.012s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:27 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[23aeb8a6-3581-46d2-acea-991f02b0dbda]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:01:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-695dffb1-d842-4996-bae0-622dbf3ad49a tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bc81dd01-2114-4a68-8119-8a2fad9fbbb1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-695dffb1-d842-4996-bae0-622dbf3ad49a tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bc81dd01-2114-4a68-8119-8a2fad9fbbb1" returned: 0 in 0.716s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:27 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-695dffb1-d842-4996-bae0-622dbf3ad49a tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bc81dd01-2114-4a68-8119-8a2fad9fbbb1 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-695dffb1-d842-4996-bae0-622dbf3ad49a tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-bc81dd01-2114-4a68-8119-8a2fad9fbbb1" returned: 0 in 0.203s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:28 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-695dffb1-d842-4996-bae0-622dbf3ad49a tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-quobyte-bc81dd01-2114-4a68-8119-8a2fad9fbbb1" released by "delete_volume" :: held 1.152s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:01:28 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-695dffb1-d842-4996-bae0-622dbf3ad49a tempest-CreateVolumesFromSnapshotTest-1666577027 None] Created reservations ['3857aa27-90e5-404d-9f82-35737a4ec42b', '15618dd8-c5df-46b3-b244-71a0d87fc454', '5278c743-6b89-49c5-aed0-0b56ef0e92b3', '48ca5138-a3bb-4423-bd5f-bc6e5c1887f7'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:01:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-695dffb1-d842-4996-bae0-622dbf3ad49a tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-695dffb1-d842-4996-bae0-622dbf3ad49a tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-695dffb1-d842-4996-bae0-622dbf3ad49a tempest-CreateVolumesFromSnapshotTest-1666577027 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:01:28 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-695dffb1-d842-4996-bae0-622dbf3ad49a tempest-CreateVolumesFromSnapshotTest-1666577027 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:01:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-695dffb1-d842-4996-bae0-622dbf3ad49a tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:28 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-695dffb1-d842-4996-bae0-622dbf3ad49a tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-695dffb1-d842-4996-bae0-622dbf3ad49a tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.213s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:29 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-695dffb1-d842-4996-bae0-622dbf3ad49a tempest-CreateVolumesFromSnapshotTest-1666577027 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 16:01:29 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-695dffb1-d842-4996-bae0-622dbf3ad49a tempest-CreateVolumesFromSnapshotTest-1666577027 None] Deleted volume successfully. Sep 10 16:01:29 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c4f90bfe-abee-4e49-8770-a38d9d3ab935 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "cinder-33e8af29-6e5b-4e42-89ea-262df54c22c6-delete_snapshot" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:29 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-695dffb1-d842-4996-bae0-622dbf3ad49a tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-bc81dd01-2114-4a68-8119-8a2fad9fbbb1-delete_volume" released by "delete_volume" :: held 2.655s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:01:29 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c4f90bfe-abee-4e49-8770-a38d9d3ab935 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-33e8af29-6e5b-4e42-89ea-262df54c22c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.134s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:29 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-c4f90bfe-abee-4e49-8770-a38d9d3ab935 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:01:29 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c4f90bfe-abee-4e49-8770-a38d9d3ab935 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "cinder-quobyte-48b31712-4501-48b8-8fab-45d1ab254768" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:29 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c4f90bfe-abee-4e49-8770-a38d9d3ab935 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-quobyte-48b31712-4501-48b8-8fab-45d1ab254768" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:29 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c4f90bfe-abee-4e49-8770-a38d9d3ab935 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "cinder-quobyte-33e8af29-6e5b-4e42-89ea-262df54c22c6" by "_delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:29 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c4f90bfe-abee-4e49-8770-a38d9d3ab935 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-quobyte-33e8af29-6e5b-4e42-89ea-262df54c22c6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-c4f90bfe-abee-4e49-8770-a38d9d3ab935 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Deleting offline snapshot 33e8af29-6e5b-4e42-89ea-262df54c22c6 of volume 48b31712-4501-48b8-8fab-45d1ab254768 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 16:01:29 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-c4f90bfe-abee-4e49-8770-a38d9d3ab935 tempest-CreateVolumesFromSnapshotTest-1666577027 None] snapshot_file for this snap is: volume-48b31712-4501-48b8-8fab-45d1ab254768.33e8af29-6e5b-4e42-89ea-262df54c22c6 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 16:01:29 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe33542-9cd6-4ac3-99b3-233c26f10393]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:01:29 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c4f90bfe-abee-4e49-8770-a38d9d3ab935 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768.33e8af29-6e5b-4e42-89ea-262df54c22c6 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:30 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 16:01:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:01:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:01:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.159s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:30 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 16:01:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c4f90bfe-abee-4e49-8770-a38d9d3ab935 tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768.33e8af29-6e5b-4e42-89ea-262df54c22c6" returned: 0 in 0.788s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-c4f90bfe-abee-4e49-8770-a38d9d3ab935 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48b31712-4501-48b8-8fab-45d1ab254768(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 16:01:30 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[a819f6ab-d73d-481a-9aa4-cc5059d5e527]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:01:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c4f90bfe-abee-4e49-8770-a38d9d3ab935 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c4f90bfe-abee-4e49-8770-a38d9d3ab935 tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768" returned: 0 in 0.547s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c4f90bfe-abee-4e49-8770-a38d9d3ab935 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768.33e8af29-6e5b-4e42-89ea-262df54c22c6 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c4f90bfe-abee-4e49-8770-a38d9d3ab935 tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768.33e8af29-6e5b-4e42-89ea-262df54c22c6" returned: 0 in 0.242s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c4f90bfe-abee-4e49-8770-a38d9d3ab935 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768.33e8af29-6e5b-4e42-89ea-262df54c22c6 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:31 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-c4f90bfe-abee-4e49-8770-a38d9d3ab935 tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768.33e8af29-6e5b-4e42-89ea-262df54c22c6" returned: 0 in 0.151s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:31 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c4f90bfe-abee-4e49-8770-a38d9d3ab935 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-quobyte-33e8af29-6e5b-4e42-89ea-262df54c22c6" released by "_delete_snapshot" :: held 2.061s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:01:31 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c4f90bfe-abee-4e49-8770-a38d9d3ab935 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-quobyte-48b31712-4501-48b8-8fab-45d1ab254768" released by "delete_snapshot" :: held 2.099s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:01:32 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-c4f90bfe-abee-4e49-8770-a38d9d3ab935 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Created reservations ['ad3d2ccf-1a23-4f14-b834-d50d9ae139ad', 'a112c8d9-23b4-49b4-ae16-f1fb652b4666', 'a2f3bc28-9a4a-4b35-a9f5-f5f4f9862961', '83592bf3-8d45-4dbd-92a3-1012fb0206e9'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:01:32 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-c4f90bfe-abee-4e49-8770-a38d9d3ab935 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Delete snapshot completed successfully. Sep 10 16:01:32 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-c4f90bfe-abee-4e49-8770-a38d9d3ab935 tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-33e8af29-6e5b-4e42-89ea-262df54c22c6-delete_snapshot" released by "delete_snapshot" :: held 2.580s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:01:32 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-6173c608-08c7-4606-8ca8-8d6e87b63dbd tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "cinder-48b31712-4501-48b8-8fab-45d1ab254768-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:32 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-6173c608-08c7-4606-8ca8-8d6e87b63dbd tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-48b31712-4501-48b8-8fab-45d1ab254768-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:32 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-6173c608-08c7-4606-8ca8-8d6e87b63dbd tempest-CreateVolumesFromSnapshotTest-1666577027 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:01:32 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-6173c608-08c7-4606-8ca8-8d6e87b63dbd tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "cinder-quobyte-48b31712-4501-48b8-8fab-45d1ab254768" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:32 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-6173c608-08c7-4606-8ca8-8d6e87b63dbd tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-quobyte-48b31712-4501-48b8-8fab-45d1ab254768" acquired by "delete_volume" :: waited 0.010s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:32 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7662a1-1366-4b1c-b82c-00c60060f3a9]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:01:32 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6173c608-08c7-4606-8ca8-8d6e87b63dbd tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6173c608-08c7-4606-8ca8-8d6e87b63dbd tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768" returned: 0 in 0.479s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6173c608-08c7-4606-8ca8-8d6e87b63dbd tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:33 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6173c608-08c7-4606-8ca8-8d6e87b63dbd tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-48b31712-4501-48b8-8fab-45d1ab254768" returned: 0 in 0.172s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:33 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-6173c608-08c7-4606-8ca8-8d6e87b63dbd tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-quobyte-48b31712-4501-48b8-8fab-45d1ab254768" released by "delete_volume" :: held 0.829s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:01:34 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-6173c608-08c7-4606-8ca8-8d6e87b63dbd tempest-CreateVolumesFromSnapshotTest-1666577027 None] Created reservations ['881dbbec-b68a-42f4-af66-f273440bfb70', '70d3a447-63e5-452d-a34e-2d8421f0437b', 'd85be6b6-e457-4cd4-a35d-f626b0fe1504', '2aa5d95e-5433-4c4d-b7be-8e08dacbc8fd'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:01:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6173c608-08c7-4606-8ca8-8d6e87b63dbd tempest-CreateVolumesFromSnapshotTest-1666577027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6173c608-08c7-4606-8ca8-8d6e87b63dbd tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:34 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6173c608-08c7-4606-8ca8-8d6e87b63dbd tempest-CreateVolumesFromSnapshotTest-1666577027 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:01:34 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-6173c608-08c7-4606-8ca8-8d6e87b63dbd tempest-CreateVolumesFromSnapshotTest-1666577027 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:01:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-6173c608-08c7-4606-8ca8-8d6e87b63dbd tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6173c608-08c7-4606-8ca8-8d6e87b63dbd tempest-CreateVolumesFromSnapshotTest-1666577027 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:34 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-6173c608-08c7-4606-8ca8-8d6e87b63dbd tempest-CreateVolumesFromSnapshotTest-1666577027 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.107s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:34 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-6173c608-08c7-4606-8ca8-8d6e87b63dbd tempest-CreateVolumesFromSnapshotTest-1666577027 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 16:01:34 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-6173c608-08c7-4606-8ca8-8d6e87b63dbd tempest-CreateVolumesFromSnapshotTest-1666577027 None] Deleted volume successfully. Sep 10 16:01:34 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-6173c608-08c7-4606-8ca8-8d6e87b63dbd tempest-CreateVolumesFromSnapshotTest-1666577027 None] Lock "cinder-48b31712-4501-48b8-8fab-45d1ab254768-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:01:38 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:01:38 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 16:01:38 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Flow 'volume_create_manager' (1fc3b428-c666-43e6-91b5-18eb0b2ee7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:01:38 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c552662f-a0eb-4000-9feb-27eb04825879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:38 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c552662f-a0eb-4000-9feb-27eb04825879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86b784b8-6269-4e58-99a3-8e25da91e7ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c33b3864c03340c59ab51dcef4a000b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:01:39Z,use_quota=True,user_id='d9954310c7be44efad6c737b5ca0989d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:38 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8803415-2f27-4e42-a3dc-3e6b7a768a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:38 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8803415-2f27-4e42-a3dc-3e6b7a768a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:38 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd3806d-29ae-498d-b76f-8a4dc0eceb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:39 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd3806d-29ae-498d-b76f-8a4dc0eceb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86b784b8-6269-4e58-99a3-8e25da91e7ef', 'volume_name': 'volume-86b784b8-6269-4e58-99a3-8e25da91e7ef', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:39 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af4dcf3-60be-44ea-a5db-5bc24c4e1efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:39 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af4dcf3-60be-44ea-a5db-5bc24c4e1efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:39 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b546143a-74fa-4edb-bb61-595f4b675cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:39 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Volume 86b784b8-6269-4e58-99a3-8e25da91e7ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86b784b8-6269-4e58-99a3-8e25da91e7ef', 'volume_size': 1} Sep 10 16:01:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:39 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86b784b8-6269-4e58-99a3-8e25da91e7ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c33b3864c03340c59ab51dcef4a000b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:01:39Z,use_quota=True,user_id='d9954310c7be44efad6c737b5ca0989d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 16:01:39 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Creating volume 86b784b8-6269-4e58-99a3-8e25da91e7ef {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 16:01:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:39 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:01:39 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:01:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:39 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 16:01:39 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 16:01:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86b784b8-6269-4e58-99a3-8e25da91e7ef 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:39 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=166, name=volume-86b784b8-6269-4e58-99a3-8e25da91e7ef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 16:01:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86b784b8-6269-4e58-99a3-8e25da91e7ef 1073741824" returned: 0 in 0.381s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86b784b8-6269-4e58-99a3-8e25da91e7ef {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86b784b8-6269-4e58-99a3-8e25da91e7ef" returned: 0 in 0.410s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:39 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] <== create_volume: return (879ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 16:01:39 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:39 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b546143a-74fa-4edb-bb61-595f4b675cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86b784b8-6269-4e58-99a3-8e25da91e7ef', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:39 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86d7cf57-eeb4-4162-8bc8-5dd8ece7595c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:40 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:01:40 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 16:01:40 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Flow 'volume_create_manager' (4a5c884e-0586-4b1f-a0a5-a58dbd1ca829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:01:40 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9e87948-6fef-43c5-8757-1776090556ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:40 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Volume volume-86b784b8-6269-4e58-99a3-8e25da91e7ef (86b784b8-6269-4e58-99a3-8e25da91e7ef): created successfully Sep 10 16:01:40 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86d7cf57-eeb4-4162-8bc8-5dd8ece7595c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:40 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Flow 'volume_create_manager' (1fc3b428-c666-43e6-91b5-18eb0b2ee7f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:01:40 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9e87948-6fef-43c5-8757-1776090556ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-653938962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b09245-40a5-4a52-8414-400be31f751e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775e51765e774ec68fdb8216777115d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:01:40Z,use_quota=True,user_id='fca5a9040a724793a38ba868bb3d3cb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:40 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ead436-64ee-4e26-a250-3eedf0484526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:40 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ead436-64ee-4e26-a250-3eedf0484526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:40 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aecd4ced-bbe6-448c-ac60-338dc8b97cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:40 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aecd4ced-bbe6-448c-ac60-338dc8b97cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80b09245-40a5-4a52-8414-400be31f751e', 'volume_name': 'volume-80b09245-40a5-4a52-8414-400be31f751e', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:40 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46dcc3a0-1f33-4431-9e08-75314cd01f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:40 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46dcc3a0-1f33-4431-9e08-75314cd01f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:40 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea6bd0d-ece2-465f-9a3f-1343fff50443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:40 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Volume 80b09245-40a5-4a52-8414-400be31f751e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80b09245-40a5-4a52-8414-400be31f751e', 'volume_size': 1} Sep 10 16:01:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:40 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-653938962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b09245-40a5-4a52-8414-400be31f751e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775e51765e774ec68fdb8216777115d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:01:40Z,use_quota=True,user_id='fca5a9040a724793a38ba868bb3d3cb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 16:01:40 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Creating volume 80b09245-40a5-4a52-8414-400be31f751e {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 16:01:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:40 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:01:40 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:01:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:40 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 16:01:40 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 16:01:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:40 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=167, name=volume-80b09245-40a5-4a52-8414-400be31f751e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 16:01:40 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-ec7a02ce-9220-4151-9f4b-fb8ad5c69a33 tempest-CinderUnicodeTest-2111056067 None] Created volume successfully. Sep 10 16:01:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e 1073741824" returned: 0 in 0.493s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:40 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e" returned: 0 in 0.116s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] <== create_volume: return (659ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea6bd0d-ece2-465f-9a3f-1343fff50443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80b09245-40a5-4a52-8414-400be31f751e', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1289c7c9-d836-4fd0-a6f2-0fcfd1c0dd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:41 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Volume volume-80b09245-40a5-4a52-8414-400be31f751e (80b09245-40a5-4a52-8414-400be31f751e): created successfully Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1289c7c9-d836-4fd0-a6f2-0fcfd1c0dd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Flow 'volume_create_manager' (4a5c884e-0586-4b1f-a0a5-a58dbd1ca829) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:01:41 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-43bd9d60-6365-4926-af4a-0a94d56091d5 tempest-SnapshotDependencyTests-1261716892 None] Created volume successfully. Sep 10 16:01:41 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Flow 'volume_create_manager' (48f23b0e-85bb-4864-9a35-85a5940d6316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93b72b35-03b7-4e5f-8e24-72428fbefe67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93b72b35-03b7-4e5f-8e24-72428fbefe67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:01:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-577903496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383247db-3cb3-4b18-9638-c8db05254891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c33b3864c03340c59ab51dcef4a000b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:01:41Z,use_quota=True,user_id='d9954310c7be44efad6c737b5ca0989d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7631942e-7e55-4f78-8f55-3a86895e3462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7631942e-7e55-4f78-8f55-3a86895e3462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6011ce6-3c99-4ac9-adff-3731e22b4c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6011ce6-3c99-4ac9-adff-3731e22b4c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '383247db-3cb3-4b18-9638-c8db05254891', 'volume_name': 'volume-383247db-3cb3-4b18-9638-c8db05254891', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (937a7de7-4ebf-47c4-8fdf-f7235eedfe19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (937a7de7-4ebf-47c4-8fdf-f7235eedfe19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4593d1e0-f1c9-4327-854d-0f2e0e3f1169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:41 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Volume 383247db-3cb3-4b18-9638-c8db05254891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-383247db-3cb3-4b18-9638-c8db05254891', 'volume_size': 1} Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:01:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-577903496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383247db-3cb3-4b18-9638-c8db05254891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c33b3864c03340c59ab51dcef4a000b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:01:41Z,use_quota=True,user_id='d9954310c7be44efad6c737b5ca0989d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)}" {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Creating volume 383247db-3cb3-4b18-9638-c8db05254891 {{(pid=82800) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 16:01:41 devstack cinder-volume[82800]: INFO cinder.volume.drivers.remotefs [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] casted to 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 Sep 10 16:01:41 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891 1073741824 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:41 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=168, name=volume-383247db-3cb3-4b18-9638-c8db05254891, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 16:01:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891 1073741824" returned: 0 in 0.389s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891" returned: 0 in 0.396s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:42 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] <== create_volume: return (851ms) {'provider_location': '10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'} {{(pid=82800) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 10 16:01:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:42 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-f08052c3-0332-439b-b0de-189d28b5f429 tempest-SnapshotDependencyTests-1261716892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:01:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f08052c3-0332-439b-b0de-189d28b5f429 tempest-SnapshotDependencyTests-1261716892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f08052c3-0332-439b-b0de-189d28b5f429 tempest-SnapshotDependencyTests-1261716892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4593d1e0-f1c9-4327-854d-0f2e0e3f1169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-383247db-3cb3-4b18-9638-c8db05254891', 'volume_size': 1}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (186b9baf-7eca-47bc-86c4-d951ce2e43b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:42 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-f08052c3-0332-439b-b0de-189d28b5f429 tempest-SnapshotDependencyTests-1261716892 None] Creating offline snapshot 124ec4d0-a346-4f06-bd5d-cd35da523108 of volume 80b09245-40a5-4a52-8414-400be31f751e {{(pid=82800) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 16:01:42 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Volume volume-383247db-3cb3-4b18-9638-c8db05254891 (383247db-3cb3-4b18-9638-c8db05254891): created successfully Sep 10 16:01:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (186b9baf-7eca-47bc-86c4-d951ce2e43b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:42 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Flow 'volume_create_manager' (48f23b0e-85bb-4864-9a35-85a5940d6316) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:01:42 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[202a02b8-863e-4bef-a743-99cec46dc49b]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:01:42 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f08052c3-0332-439b-b0de-189d28b5f429 tempest-SnapshotDependencyTests-1261716892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:43 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-83b3c1db-7bcb-4331-bd50-6d7ea8f74623 tempest-CinderUnicodeTest-2111056067 None] Created volume successfully. Sep 10 16:01:43 devstack quobyte-client[82814]: System call of process 100751 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 16:01:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f08052c3-0332-439b-b0de-189d28b5f429 tempest-SnapshotDependencyTests-1261716892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e" returned: 0 in 0.535s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f08052c3-0332-439b-b0de-189d28b5f429 tempest-SnapshotDependencyTests-1261716892 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e.124ec4d0-a346-4f06-bd5d-cd35da523108 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:43 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=169, name=volume-80b09245-40a5-4a52-8414-400be31f751e.124ec4d0-a346-4f06-bd5d-cd35da523108, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 16:01:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f08052c3-0332-439b-b0de-189d28b5f429 tempest-SnapshotDependencyTests-1261716892 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e.124ec4d0-a346-4f06-bd5d-cd35da523108 1G" returned: 0 in 0.326s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f08052c3-0332-439b-b0de-189d28b5f429 tempest-SnapshotDependencyTests-1261716892 None] Running cmd (subprocess): qemu-img rebase -u -b volume-80b09245-40a5-4a52-8414-400be31f751e -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e.124ec4d0-a346-4f06-bd5d-cd35da523108 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f08052c3-0332-439b-b0de-189d28b5f429 tempest-SnapshotDependencyTests-1261716892 None] CMD "qemu-img rebase -u -b volume-80b09245-40a5-4a52-8414-400be31f751e -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e.124ec4d0-a346-4f06-bd5d-cd35da523108" returned: 0 in 0.165s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:43 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-f08052c3-0332-439b-b0de-189d28b5f429 tempest-SnapshotDependencyTests-1261716892 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e.124ec4d0-a346-4f06-bd5d-cd35da523108 is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 16:01:43 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f08052c3-0332-439b-b0de-189d28b5f429 tempest-SnapshotDependencyTests-1261716892 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e.124ec4d0-a346-4f06-bd5d-cd35da523108 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f08052c3-0332-439b-b0de-189d28b5f429 tempest-SnapshotDependencyTests-1261716892 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e.124ec4d0-a346-4f06-bd5d-cd35da523108" returned: 0 in 0.159s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-f08052c3-0332-439b-b0de-189d28b5f429 tempest-SnapshotDependencyTests-1261716892 None] Setting permissions: /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e -> 1000:1000 {{(pid=82800) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 16:01:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f08052c3-0332-439b-b0de-189d28b5f429 tempest-SnapshotDependencyTests-1261716892 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e.124ec4d0-a346-4f06-bd5d-cd35da523108 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f08052c3-0332-439b-b0de-189d28b5f429 tempest-SnapshotDependencyTests-1261716892 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e.124ec4d0-a346-4f06-bd5d-cd35da523108" returned: 0 in 0.367s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f08052c3-0332-439b-b0de-189d28b5f429 tempest-SnapshotDependencyTests-1261716892 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:44 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-fb7bcccd-cba6-42fd-9b6d-b61447c42b1d tempest-CinderUnicodeTest-2111056067 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:01:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-fb7bcccd-cba6-42fd-9b6d-b61447c42b1d tempest-CinderUnicodeTest-2111056067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f08052c3-0332-439b-b0de-189d28b5f429 tempest-SnapshotDependencyTests-1261716892 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e.info" returned: 0 in 0.170s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:44 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-f08052c3-0332-439b-b0de-189d28b5f429 tempest-SnapshotDependencyTests-1261716892 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e.info is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 16:01:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f08052c3-0332-439b-b0de-189d28b5f429 tempest-SnapshotDependencyTests-1261716892 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-f08052c3-0332-439b-b0de-189d28b5f429 tempest-SnapshotDependencyTests-1261716892 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e.info" returned: 0 in 0.096s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-f08052c3-0332-439b-b0de-189d28b5f429 tempest-SnapshotDependencyTests-1261716892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.163s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:44 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-fb7bcccd-cba6-42fd-9b6d-b61447c42b1d tempest-CinderUnicodeTest-2111056067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.332s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:45 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-fb7bcccd-cba6-42fd-9b6d-b61447c42b1d tempest-CinderUnicodeTest-2111056067 None] Creating offline snapshot a1a1e392-afc7-4b2f-b2f7-57fcca7ac29f of volume 383247db-3cb3-4b18-9638-c8db05254891 {{(pid=82800) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 10 16:01:45 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-f08052c3-0332-439b-b0de-189d28b5f429 tempest-SnapshotDependencyTests-1261716892 None] Create snapshot completed successfully Sep 10 16:01:45 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[33609f49-cbd9-496b-8ece-7da6fa050b63]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:01:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fb7bcccd-cba6-42fd-9b6d-b61447c42b1d tempest-CinderUnicodeTest-2111056067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fb7bcccd-cba6-42fd-9b6d-b61447c42b1d tempest-CinderUnicodeTest-2111056067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891" returned: 0 in 0.503s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fb7bcccd-cba6-42fd-9b6d-b61447c42b1d tempest-CinderUnicodeTest-2111056067 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891.a1a1e392-afc7-4b2f-b2f7-57fcca7ac29f 1G {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:45 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=171, name=volume-383247db-3cb3-4b18-9638-c8db05254891.a1a1e392-afc7-4b2f-b2f7-57fcca7ac29f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 16:01:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fb7bcccd-cba6-42fd-9b6d-b61447c42b1d tempest-CinderUnicodeTest-2111056067 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891.a1a1e392-afc7-4b2f-b2f7-57fcca7ac29f 1G" returned: 0 in 0.273s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:45 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fb7bcccd-cba6-42fd-9b6d-b61447c42b1d tempest-CinderUnicodeTest-2111056067 None] Running cmd (subprocess): qemu-img rebase -u -b volume-383247db-3cb3-4b18-9638-c8db05254891 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891.a1a1e392-afc7-4b2f-b2f7-57fcca7ac29f {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fb7bcccd-cba6-42fd-9b6d-b61447c42b1d tempest-CinderUnicodeTest-2111056067 None] CMD "qemu-img rebase -u -b volume-383247db-3cb3-4b18-9638-c8db05254891 -F qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891.a1a1e392-afc7-4b2f-b2f7-57fcca7ac29f" returned: 0 in 0.400s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-fb7bcccd-cba6-42fd-9b6d-b61447c42b1d tempest-CinderUnicodeTest-2111056067 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891.a1a1e392-afc7-4b2f-b2f7-57fcca7ac29f is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 16:01:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fb7bcccd-cba6-42fd-9b6d-b61447c42b1d tempest-CinderUnicodeTest-2111056067 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891.a1a1e392-afc7-4b2f-b2f7-57fcca7ac29f {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:46 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:01:46 devstack cinder-volume[82800]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82800) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1385}} Sep 10 16:01:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fb7bcccd-cba6-42fd-9b6d-b61447c42b1d tempest-CinderUnicodeTest-2111056067 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891.a1a1e392-afc7-4b2f-b2f7-57fcca7ac29f" returned: 0 in 0.277s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:46 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-fb7bcccd-cba6-42fd-9b6d-b61447c42b1d tempest-CinderUnicodeTest-2111056067 None] Setting permissions: /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891 -> 1000:1000 {{(pid=82800) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 10 16:01:46 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fb7bcccd-cba6-42fd-9b6d-b61447c42b1d tempest-CinderUnicodeTest-2111056067 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891.a1a1e392-afc7-4b2f-b2f7-57fcca7ac29f {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Flow 'volume_create_manager' (a409c24d-a80e-4ea3-b759-a12509117966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:01:46 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a290ba71-421b-4a90-951c-970ea3691dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fb7bcccd-cba6-42fd-9b6d-b61447c42b1d tempest-CinderUnicodeTest-2111056067 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891.a1a1e392-afc7-4b2f-b2f7-57fcca7ac29f" returned: 0 in 0.393s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fb7bcccd-cba6-42fd-9b6d-b61447c42b1d tempest-CinderUnicodeTest-2111056067 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a290ba71-421b-4a90-951c-970ea3691dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-10T14:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775e51765e774ec68fdb8216777115d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-10T14:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=124ec4d0-a346-4f06-bd5d-cd35da523108,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-10T14:01:46Z,use_quota=True,user_id='fca5a9040a724793a38ba868bb3d3cb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(42f844eb-1426-45e1-8a22-1ef604c6ebe6),volume_type_id=42f844eb-1426-45e1-8a22-1ef604c6ebe6)' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa98c86-b5ff-4baa-9b72-9f9d30b2be17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fa98c86-b5ff-4baa-9b72-9f9d30b2be17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f5f300-6e15-4ed4-a2ad-dd0f35d455c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f5f300-6e15-4ed4-a2ad-dd0f35d455c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec', 'volume_name': 'volume-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec', 'volume_size': 1, 'snapshot_id': '124ec4d0-a346-4f06-bd5d-cd35da523108'}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2944378d-24d1-4380-a509-2062afc05ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2944378d-24d1-4380-a509-2062afc05ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39c53472-89a2-42c5-8137-7c1cb3e7b152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:47 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Volume 6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec', 'volume_size': 1, 'snapshot_id': '124ec4d0-a346-4f06-bd5d-cd35da523108'} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fb7bcccd-cba6-42fd-9b6d-b61447c42b1d tempest-CinderUnicodeTest-2111056067 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891.info" returned: 0 in 0.406s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-fb7bcccd-cba6-42fd-9b6d-b61447c42b1d tempest-CinderUnicodeTest-2111056067 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891.info is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fb7bcccd-cba6-42fd-9b6d-b61447c42b1d tempest-CinderUnicodeTest-2111056067 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891.info {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fb7bcccd-cba6-42fd-9b6d-b61447c42b1d tempest-CinderUnicodeTest-2111056067 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891.info" returned: 0 in 0.169s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-fb7bcccd-cba6-42fd-9b6d-b61447c42b1d tempest-CinderUnicodeTest-2111056067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.674s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.150s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Acquiring lock "cinder-quobyte-124ec4d0-a346-4f06-bd5d-cd35da523108-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec" by "_create_volume_from_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Lock "cinder-quobyte-124ec4d0-a346-4f06-bd5d-cd35da523108-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec" acquired by "_create_volume_from_snapshot" :: waited 0.150s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Creating volume 6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec from snapshot 124ec4d0-a346-4f06-bd5d-cd35da523108 {{(pid=82800) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Selected 10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5 as target Quobyte volume. {{(pid=82800) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Acquiring lock "cinder-quobyte-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec" by "_copy_volume_from_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:47 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-fb7bcccd-cba6-42fd-9b6d-b61447c42b1d tempest-CinderUnicodeTest-2111056067 None] Create snapshot completed successfully Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Lock "cinder-quobyte-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] snapshot: 124ec4d0-a346-4f06-bd5d-cd35da523108, volume: 6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec, {{(pid=82800) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[198d2785-6a94-4f16-a70c-5c89a4102466]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:01:47 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e.124ec4d0-a346-4f06-bd5d-cd35da523108 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e.124ec4d0-a346-4f06-bd5d-cd35da523108" returned: 0 in 0.423s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:48 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80b09245-40a5-4a52-8414-400be31f751e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 16:01:48 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e {{(pid=82800) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 10 16:01:48 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Creating direct copy from snapshot {{(pid=82800) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 10 16:01:48 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fa71729c-a2b7-47d4-a81f-c996676ab8ab tempest-CinderUnicodeTest-2111056067 None] Acquiring lock "cinder-a1a1e392-afc7-4b2f-b2f7-57fcca7ac29f-delete_snapshot" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:48 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b28dd0-0751-40c5-8faa-6b6259692701]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:01:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:48 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fa71729c-a2b7-47d4-a81f-c996676ab8ab tempest-CinderUnicodeTest-2111056067 None] Lock "cinder-a1a1e392-afc7-4b2f-b2f7-57fcca7ac29f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.234s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:48 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-fa71729c-a2b7-47d4-a81f-c996676ab8ab tempest-CinderUnicodeTest-2111056067 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:01:48 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fa71729c-a2b7-47d4-a81f-c996676ab8ab tempest-CinderUnicodeTest-2111056067 None] Acquiring lock "cinder-quobyte-383247db-3cb3-4b18-9638-c8db05254891" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:48 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fa71729c-a2b7-47d4-a81f-c996676ab8ab tempest-CinderUnicodeTest-2111056067 None] Lock "cinder-quobyte-383247db-3cb3-4b18-9638-c8db05254891" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:48 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fa71729c-a2b7-47d4-a81f-c996676ab8ab tempest-CinderUnicodeTest-2111056067 None] Acquiring lock "cinder-quobyte-a1a1e392-afc7-4b2f-b2f7-57fcca7ac29f" by "_delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:48 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fa71729c-a2b7-47d4-a81f-c996676ab8ab tempest-CinderUnicodeTest-2111056067 None] Lock "cinder-quobyte-a1a1e392-afc7-4b2f-b2f7-57fcca7ac29f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:48 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-fa71729c-a2b7-47d4-a81f-c996676ab8ab tempest-CinderUnicodeTest-2111056067 None] Deleting offline snapshot a1a1e392-afc7-4b2f-b2f7-57fcca7ac29f of volume 383247db-3cb3-4b18-9638-c8db05254891 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 16:01:48 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-fa71729c-a2b7-47d4-a81f-c996676ab8ab tempest-CinderUnicodeTest-2111056067 None] snapshot_file for this snap is: volume-383247db-3cb3-4b18-9638-c8db05254891.a1a1e392-afc7-4b2f-b2f7-57fcca7ac29f {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 16:01:48 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4c1613-b468-485b-9a21-4ddf19639bcf]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:01:48 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fa71729c-a2b7-47d4-a81f-c996676ab8ab tempest-CinderUnicodeTest-2111056067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891.a1a1e392-afc7-4b2f-b2f7-57fcca7ac29f {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e" returned: 0 in 0.563s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:49 devstack cinder-volume[82800]: DEBUG cinder.utils [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec not found in is_blk_device check {{(pid=82800) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 10 16:01:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:49 devstack quobyte-client[82814]: System call of process 100785 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 16:01:49 devstack quobyte-client[82814]: The server volume:901d48c4-abeb-4e73-8233-dbfe6d0c74aa@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=901d48c4-abeb-4e73-8233-dbfe6d0c74aa, inode=173, name=volume-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.60), requestorAccessMask=0 Sep 10 16:01:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fa71729c-a2b7-47d4-a81f-c996676ab8ab tempest-CinderUnicodeTest-2111056067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891.a1a1e392-afc7-4b2f-b2f7-57fcca7ac29f" returned: 0 in 0.572s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:49 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-fa71729c-a2b7-47d4-a81f-c996676ab8ab tempest-CinderUnicodeTest-2111056067 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-383247db-3cb3-4b18-9638-c8db05254891(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 16:01:49 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[9241ff8c-5ced-4bbe-aada-138f6e66ac9d]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:01:49 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fa71729c-a2b7-47d4-a81f-c996676ab8ab tempest-CinderUnicodeTest-2111056067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:50 devstack quobyte-client[82814]: System call of process 100790 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 16:01:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fa71729c-a2b7-47d4-a81f-c996676ab8ab tempest-CinderUnicodeTest-2111056067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891" returned: 0 in 1.355s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fa71729c-a2b7-47d4-a81f-c996676ab8ab tempest-CinderUnicodeTest-2111056067 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891.a1a1e392-afc7-4b2f-b2f7-57fcca7ac29f {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:51 devstack quobyte-client[82814]: System call of process 100802 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 16:01:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fa71729c-a2b7-47d4-a81f-c996676ab8ab tempest-CinderUnicodeTest-2111056067 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891.a1a1e392-afc7-4b2f-b2f7-57fcca7ac29f" returned: 0 in 0.665s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:51 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fa71729c-a2b7-47d4-a81f-c996676ab8ab tempest-CinderUnicodeTest-2111056067 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891.a1a1e392-afc7-4b2f-b2f7-57fcca7ac29f {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:52 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-fa71729c-a2b7-47d4-a81f-c996676ab8ab tempest-CinderUnicodeTest-2111056067 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891.a1a1e392-afc7-4b2f-b2f7-57fcca7ac29f" returned: 0 in 0.304s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:52 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fa71729c-a2b7-47d4-a81f-c996676ab8ab tempest-CinderUnicodeTest-2111056067 None] Lock "cinder-quobyte-a1a1e392-afc7-4b2f-b2f7-57fcca7ac29f" released by "_delete_snapshot" :: held 3.784s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:01:52 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fa71729c-a2b7-47d4-a81f-c996676ab8ab tempest-CinderUnicodeTest-2111056067 None] Lock "cinder-quobyte-383247db-3cb3-4b18-9638-c8db05254891" released by "delete_snapshot" :: held 4.010s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:01:53 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-fa71729c-a2b7-47d4-a81f-c996676ab8ab tempest-CinderUnicodeTest-2111056067 None] Created reservations ['87db1193-8a40-425d-ac62-f18a84efa2bc', '6af2b55b-092a-48c5-a5ce-54820e097438', 'eb2893ac-e0e5-4046-97b7-6393123241ea', '50150634-69e6-4e8d-bc5d-57c6b568c0fb'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:01:53 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-fa71729c-a2b7-47d4-a81f-c996676ab8ab tempest-CinderUnicodeTest-2111056067 None] Delete snapshot completed successfully. Sep 10 16:01:53 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-fa71729c-a2b7-47d4-a81f-c996676ab8ab tempest-CinderUnicodeTest-2111056067 None] Lock "cinder-a1a1e392-afc7-4b2f-b2f7-57fcca7ac29f-delete_snapshot" released by "delete_snapshot" :: held 4.999s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:01:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-5c3b3a6d-5b9d-4024-b982-626071577d99 tempest-CinderUnicodeTest-2111056067 None] Acquiring lock "cinder-383247db-3cb3-4b18-9638-c8db05254891-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-5c3b3a6d-5b9d-4024-b982-626071577d99 tempest-CinderUnicodeTest-2111056067 None] Lock "cinder-383247db-3cb3-4b18-9638-c8db05254891-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:54 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-5c3b3a6d-5b9d-4024-b982-626071577d99 tempest-CinderUnicodeTest-2111056067 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:01:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-5c3b3a6d-5b9d-4024-b982-626071577d99 tempest-CinderUnicodeTest-2111056067 None] Acquiring lock "cinder-quobyte-383247db-3cb3-4b18-9638-c8db05254891" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:54 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-5c3b3a6d-5b9d-4024-b982-626071577d99 tempest-CinderUnicodeTest-2111056067 None] Lock "cinder-quobyte-383247db-3cb3-4b18-9638-c8db05254891" acquired by "delete_volume" :: waited 0.047s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:55 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cc8158-34dc-4737-8b33-e7fd6a19f8b4]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:01:55 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5c3b3a6d-5b9d-4024-b982-626071577d99 tempest-CinderUnicodeTest-2111056067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec" returned: 0 in 6.742s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:56 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06c1829-ae22-4a92-bc7e-58513caa84e7]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:01:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5c3b3a6d-5b9d-4024-b982-626071577d99 tempest-CinderUnicodeTest-2111056067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891" returned: 0 in 1.159s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5c3b3a6d-5b9d-4024-b982-626071577d99 tempest-CinderUnicodeTest-2111056067 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5c3b3a6d-5b9d-4024-b982-626071577d99 tempest-CinderUnicodeTest-2111056067 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-383247db-3cb3-4b18-9638-c8db05254891" returned: 0 in 0.113s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:56 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-5c3b3a6d-5b9d-4024-b982-626071577d99 tempest-CinderUnicodeTest-2111056067 None] Lock "cinder-quobyte-383247db-3cb3-4b18-9638-c8db05254891" released by "delete_volume" :: held 1.572s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:01:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e" returned: 0 in 0.701s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:56 devstack cinder-volume[82800]: DEBUG cinder.image.image_utils [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Image conversion details: src /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e, size 1024.00 MB, duration 6.78 sec, destination /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec {{(pid=82800) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 10 16:01:56 devstack cinder-volume[82800]: INFO cinder.image.image_utils [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Converted 1024.00 MB image at 151.14 MB/s Sep 10 16:01:56 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] File path /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec is being set with permissions: 660 {{(pid=82800) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 10 16:01:56 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:56 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-5c3b3a6d-5b9d-4024-b982-626071577d99 tempest-CinderUnicodeTest-2111056067 None] Created reservations ['e0434146-6a26-4d21-a986-956b520f6987', '112464fa-87eb-46cc-b43a-2cc1c74afcf9', '766704a9-598b-4569-93ef-50289c59ec8f', 'b5bd3198-ad4e-4e7b-ac29-1c72a2a01942'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:01:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec" returned: 0 in 0.388s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:57 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Lock "cinder-quobyte-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec" released by "_copy_volume_from_snapshot" :: held 9.293s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:01:57 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Lock "cinder-quobyte-124ec4d0-a346-4f06-bd5d-cd35da523108-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec" released by "_create_volume_from_snapshot" :: held 9.359s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:01:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.521s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:57 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39c53472-89a2-42c5-8137-7c1cb3e7b152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec', 'volume_size': 1, 'snapshot_id': '124ec4d0-a346-4f06-bd5d-cd35da523108'}' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:57 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8900b3c9-b3f3-4a97-9111-5cca5810bb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 10 16:01:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-5c3b3a6d-5b9d-4024-b982-626071577d99 tempest-CinderUnicodeTest-2111056067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:01:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-5c3b3a6d-5b9d-4024-b982-626071577d99 tempest-CinderUnicodeTest-2111056067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:01:57 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-5c3b3a6d-5b9d-4024-b982-626071577d99 tempest-CinderUnicodeTest-2111056067 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:01:57 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-5c3b3a6d-5b9d-4024-b982-626071577d99 tempest-CinderUnicodeTest-2111056067 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:01:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-5c3b3a6d-5b9d-4024-b982-626071577d99 tempest-CinderUnicodeTest-2111056067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:01:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5c3b3a6d-5b9d-4024-b982-626071577d99 tempest-CinderUnicodeTest-2111056067 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:57 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-5c3b3a6d-5b9d-4024-b982-626071577d99 tempest-CinderUnicodeTest-2111056067 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.134s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:57 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-5c3b3a6d-5b9d-4024-b982-626071577d99 tempest-CinderUnicodeTest-2111056067 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 16:01:57 devstack cinder-volume[82800]: INFO cinder.volume.flows.manager.create_volume [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Volume volume-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec (6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec): created successfully Sep 10 16:01:57 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8900b3c9-b3f3-4a97-9111-5cca5810bb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82800) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 10 16:01:57 devstack cinder-volume[82800]: DEBUG cinder.volume.manager [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Flow 'volume_create_manager' (a409c24d-a80e-4ea3-b759-a12509117966) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82800) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 10 16:01:57 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-5c3b3a6d-5b9d-4024-b982-626071577d99 tempest-CinderUnicodeTest-2111056067 None] Deleted volume successfully. Sep 10 16:01:57 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-5c3b3a6d-5b9d-4024-b982-626071577d99 tempest-CinderUnicodeTest-2111056067 None] Lock "cinder-383247db-3cb3-4b18-9638-c8db05254891-delete_volume" released by "delete_volume" :: held 3.295s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:01:57 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-a8eda07d-a469-4b6b-940f-9a3fb6ada44b tempest-SnapshotDependencyTests-1261716892 None] Created volume successfully. Sep 10 16:01:58 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-24e7609d-56ea-40bf-997c-9a9ef8a986be tempest-SnapshotDependencyTests-1261716892 None] Acquiring lock "cinder-124ec4d0-a346-4f06-bd5d-cd35da523108-delete_snapshot" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:58 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-24e7609d-56ea-40bf-997c-9a9ef8a986be tempest-SnapshotDependencyTests-1261716892 None] Lock "cinder-124ec4d0-a346-4f06-bd5d-cd35da523108-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:58 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-24e7609d-56ea-40bf-997c-9a9ef8a986be tempest-SnapshotDependencyTests-1261716892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:01:58 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-24e7609d-56ea-40bf-997c-9a9ef8a986be tempest-SnapshotDependencyTests-1261716892 None] Acquiring lock "cinder-quobyte-80b09245-40a5-4a52-8414-400be31f751e" by "delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:58 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-24e7609d-56ea-40bf-997c-9a9ef8a986be tempest-SnapshotDependencyTests-1261716892 None] Lock "cinder-quobyte-80b09245-40a5-4a52-8414-400be31f751e" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:58 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-24e7609d-56ea-40bf-997c-9a9ef8a986be tempest-SnapshotDependencyTests-1261716892 None] Acquiring lock "cinder-quobyte-124ec4d0-a346-4f06-bd5d-cd35da523108" by "_delete_snapshot" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:58 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-24e7609d-56ea-40bf-997c-9a9ef8a986be tempest-SnapshotDependencyTests-1261716892 None] Lock "cinder-quobyte-124ec4d0-a346-4f06-bd5d-cd35da523108" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-24e7609d-56ea-40bf-997c-9a9ef8a986be tempest-SnapshotDependencyTests-1261716892 None] Deleting offline snapshot 124ec4d0-a346-4f06-bd5d-cd35da523108 of volume 80b09245-40a5-4a52-8414-400be31f751e {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 10 16:01:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-24e7609d-56ea-40bf-997c-9a9ef8a986be tempest-SnapshotDependencyTests-1261716892 None] snapshot_file for this snap is: volume-80b09245-40a5-4a52-8414-400be31f751e.124ec4d0-a346-4f06-bd5d-cd35da523108 {{(pid=82800) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 10 16:01:58 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[028e4886-c229-47c3-ab3d-98ce53ebdfd2]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:01:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-24e7609d-56ea-40bf-997c-9a9ef8a986be tempest-SnapshotDependencyTests-1261716892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e.124ec4d0-a346-4f06-bd5d-cd35da523108 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:58 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-cd709055-5d3f-4223-96f8-9d214c4d9af4 tempest-CinderUnicodeTest-2111056067 None] Acquiring lock "cinder-86b784b8-6269-4e58-99a3-8e25da91e7ef-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:58 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-cd709055-5d3f-4223-96f8-9d214c4d9af4 tempest-CinderUnicodeTest-2111056067 None] Lock "cinder-86b784b8-6269-4e58-99a3-8e25da91e7ef-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:58 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-cd709055-5d3f-4223-96f8-9d214c4d9af4 tempest-CinderUnicodeTest-2111056067 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:01:58 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-cd709055-5d3f-4223-96f8-9d214c4d9af4 tempest-CinderUnicodeTest-2111056067 None] Acquiring lock "cinder-quobyte-86b784b8-6269-4e58-99a3-8e25da91e7ef" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:01:58 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-cd709055-5d3f-4223-96f8-9d214c4d9af4 tempest-CinderUnicodeTest-2111056067 None] Lock "cinder-quobyte-86b784b8-6269-4e58-99a3-8e25da91e7ef" acquired by "delete_volume" :: waited 0.011s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:01:58 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[87279326-0beb-4e2c-8696-d269db52614b]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:01:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cd709055-5d3f-4223-96f8-9d214c4d9af4 tempest-CinderUnicodeTest-2111056067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86b784b8-6269-4e58-99a3-8e25da91e7ef {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-24e7609d-56ea-40bf-997c-9a9ef8a986be tempest-SnapshotDependencyTests-1261716892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e.124ec4d0-a346-4f06-bd5d-cd35da523108" returned: 0 in 0.634s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:58 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.remotefs [None req-24e7609d-56ea-40bf-997c-9a9ef8a986be tempest-SnapshotDependencyTests-1261716892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80b09245-40a5-4a52-8414-400be31f751e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82800) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 10 16:01:58 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae11b62-03ab-4f2c-bc73-a8e4014ed5e0]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:01:58 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-24e7609d-56ea-40bf-997c-9a9ef8a986be tempest-SnapshotDependencyTests-1261716892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cd709055-5d3f-4223-96f8-9d214c4d9af4 tempest-CinderUnicodeTest-2111056067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86b784b8-6269-4e58-99a3-8e25da91e7ef" returned: 0 in 0.544s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cd709055-5d3f-4223-96f8-9d214c4d9af4 tempest-CinderUnicodeTest-2111056067 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86b784b8-6269-4e58-99a3-8e25da91e7ef {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-24e7609d-56ea-40bf-997c-9a9ef8a986be tempest-SnapshotDependencyTests-1261716892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e" returned: 0 in 0.534s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-24e7609d-56ea-40bf-997c-9a9ef8a986be tempest-SnapshotDependencyTests-1261716892 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e.124ec4d0-a346-4f06-bd5d-cd35da523108 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:01:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cd709055-5d3f-4223-96f8-9d214c4d9af4 tempest-CinderUnicodeTest-2111056067 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-86b784b8-6269-4e58-99a3-8e25da91e7ef" returned: 0 in 0.225s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:59 devstack quobyte-client[82814]: System call of process 100827 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 10 16:01:59 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-cd709055-5d3f-4223-96f8-9d214c4d9af4 tempest-CinderUnicodeTest-2111056067 None] Lock "cinder-quobyte-86b784b8-6269-4e58-99a3-8e25da91e7ef" released by "delete_volume" :: held 0.953s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:01:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-24e7609d-56ea-40bf-997c-9a9ef8a986be tempest-SnapshotDependencyTests-1261716892 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e.124ec4d0-a346-4f06-bd5d-cd35da523108" returned: 0 in 0.366s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:01:59 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-24e7609d-56ea-40bf-997c-9a9ef8a986be tempest-SnapshotDependencyTests-1261716892 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e.124ec4d0-a346-4f06-bd5d-cd35da523108 {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:02:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-24e7609d-56ea-40bf-997c-9a9ef8a986be tempest-SnapshotDependencyTests-1261716892 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e.124ec4d0-a346-4f06-bd5d-cd35da523108" returned: 0 in 0.211s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:02:00 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-24e7609d-56ea-40bf-997c-9a9ef8a986be tempest-SnapshotDependencyTests-1261716892 None] Lock "cinder-quobyte-124ec4d0-a346-4f06-bd5d-cd35da523108" released by "_delete_snapshot" :: held 2.063s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:02:00 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-24e7609d-56ea-40bf-997c-9a9ef8a986be tempest-SnapshotDependencyTests-1261716892 None] Lock "cinder-quobyte-80b09245-40a5-4a52-8414-400be31f751e" released by "delete_snapshot" :: held 2.093s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:02:00 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-cd709055-5d3f-4223-96f8-9d214c4d9af4 tempest-CinderUnicodeTest-2111056067 None] Created reservations ['47c1d909-5d0d-4a4d-8092-eeec4742b6ef', '22bdab3c-f65e-43ea-b7a9-f99e9730664e', '17254219-8c97-4ea6-b391-55a14b6566c8', 'bce7a4dd-be69-4af0-81ad-da0740cd2682'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:02:00 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-24e7609d-56ea-40bf-997c-9a9ef8a986be tempest-SnapshotDependencyTests-1261716892 None] Created reservations ['65e2847b-5628-4f6e-a8ba-5480e4694024', 'f18dddb3-994c-4718-ad31-25d3bddd5b2e', 'b563ed39-4146-4b62-a2c5-e5cacf2c8544', 'd2a07d74-90f4-4bd9-965e-f3518de92097'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:02:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-cd709055-5d3f-4223-96f8-9d214c4d9af4 tempest-CinderUnicodeTest-2111056067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:02:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-cd709055-5d3f-4223-96f8-9d214c4d9af4 tempest-CinderUnicodeTest-2111056067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:02:00 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-cd709055-5d3f-4223-96f8-9d214c4d9af4 tempest-CinderUnicodeTest-2111056067 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:02:00 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-cd709055-5d3f-4223-96f8-9d214c4d9af4 tempest-CinderUnicodeTest-2111056067 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:02:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-cd709055-5d3f-4223-96f8-9d214c4d9af4 tempest-CinderUnicodeTest-2111056067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:02:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cd709055-5d3f-4223-96f8-9d214c4d9af4 tempest-CinderUnicodeTest-2111056067 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:02:00 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-cd709055-5d3f-4223-96f8-9d214c4d9af4 tempest-CinderUnicodeTest-2111056067 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.300s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:02:00 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-cd709055-5d3f-4223-96f8-9d214c4d9af4 tempest-CinderUnicodeTest-2111056067 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 16:02:00 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-24e7609d-56ea-40bf-997c-9a9ef8a986be tempest-SnapshotDependencyTests-1261716892 None] Delete snapshot completed successfully. Sep 10 16:02:01 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-cd709055-5d3f-4223-96f8-9d214c4d9af4 tempest-CinderUnicodeTest-2111056067 None] Deleted volume successfully. Sep 10 16:02:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-24e7609d-56ea-40bf-997c-9a9ef8a986be tempest-SnapshotDependencyTests-1261716892 None] Lock "cinder-124ec4d0-a346-4f06-bd5d-cd35da523108-delete_snapshot" released by "delete_snapshot" :: held 2.978s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:02:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-cd709055-5d3f-4223-96f8-9d214c4d9af4 tempest-CinderUnicodeTest-2111056067 None] Lock "cinder-86b784b8-6269-4e58-99a3-8e25da91e7ef-delete_volume" released by "delete_volume" :: held 2.671s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:02:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-83ccf90d-87aa-487e-ba2f-1d907c3ea260 tempest-SnapshotDependencyTests-1261716892 None] Acquiring lock "cinder-80b09245-40a5-4a52-8414-400be31f751e-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:02:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-83ccf90d-87aa-487e-ba2f-1d907c3ea260 tempest-SnapshotDependencyTests-1261716892 None] Lock "cinder-80b09245-40a5-4a52-8414-400be31f751e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:02:01 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-83ccf90d-87aa-487e-ba2f-1d907c3ea260 tempest-SnapshotDependencyTests-1261716892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:02:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-83ccf90d-87aa-487e-ba2f-1d907c3ea260 tempest-SnapshotDependencyTests-1261716892 None] Acquiring lock "cinder-quobyte-80b09245-40a5-4a52-8414-400be31f751e" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:02:01 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-83ccf90d-87aa-487e-ba2f-1d907c3ea260 tempest-SnapshotDependencyTests-1261716892 None] Lock "cinder-quobyte-80b09245-40a5-4a52-8414-400be31f751e" acquired by "delete_volume" :: waited 0.010s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:02:01 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d260eb-a3bf-45ee-be4b-538b9573106e]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:02:01 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-83ccf90d-87aa-487e-ba2f-1d907c3ea260 tempest-SnapshotDependencyTests-1261716892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:02:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-83ccf90d-87aa-487e-ba2f-1d907c3ea260 tempest-SnapshotDependencyTests-1261716892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e" returned: 0 in 0.541s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:02:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-83ccf90d-87aa-487e-ba2f-1d907c3ea260 tempest-SnapshotDependencyTests-1261716892 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:02:02 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-83ccf90d-87aa-487e-ba2f-1d907c3ea260 tempest-SnapshotDependencyTests-1261716892 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-80b09245-40a5-4a52-8414-400be31f751e" returned: 0 in 0.136s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:02:02 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-83ccf90d-87aa-487e-ba2f-1d907c3ea260 tempest-SnapshotDependencyTests-1261716892 None] Lock "cinder-quobyte-80b09245-40a5-4a52-8414-400be31f751e" released by "delete_volume" :: held 0.851s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:02:02 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-83ccf90d-87aa-487e-ba2f-1d907c3ea260 tempest-SnapshotDependencyTests-1261716892 None] Created reservations ['c4bbedf4-d59f-460e-aba6-6d8953dd000a', '8331ccfb-a368-4ace-aba8-0a887575c656', '9586a91a-87e2-43fd-8974-ba46569f7229', '562d5975-062e-4fe5-b314-b511e1fd086c'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:02:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-83ccf90d-87aa-487e-ba2f-1d907c3ea260 tempest-SnapshotDependencyTests-1261716892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:02:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-83ccf90d-87aa-487e-ba2f-1d907c3ea260 tempest-SnapshotDependencyTests-1261716892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:02:03 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-83ccf90d-87aa-487e-ba2f-1d907c3ea260 tempest-SnapshotDependencyTests-1261716892 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:02:03 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-83ccf90d-87aa-487e-ba2f-1d907c3ea260 tempest-SnapshotDependencyTests-1261716892 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:02:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-83ccf90d-87aa-487e-ba2f-1d907c3ea260 tempest-SnapshotDependencyTests-1261716892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:02:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-83ccf90d-87aa-487e-ba2f-1d907c3ea260 tempest-SnapshotDependencyTests-1261716892 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:02:03 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-83ccf90d-87aa-487e-ba2f-1d907c3ea260 tempest-SnapshotDependencyTests-1261716892 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.107s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:02:03 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-83ccf90d-87aa-487e-ba2f-1d907c3ea260 tempest-SnapshotDependencyTests-1261716892 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 16:02:03 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-83ccf90d-87aa-487e-ba2f-1d907c3ea260 tempest-SnapshotDependencyTests-1261716892 None] Deleted volume successfully. Sep 10 16:02:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-83ccf90d-87aa-487e-ba2f-1d907c3ea260 tempest-SnapshotDependencyTests-1261716892 None] Lock "cinder-80b09245-40a5-4a52-8414-400be31f751e-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:02:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-27914f54-6590-48fd-b59d-aaedec64e8f2 tempest-SnapshotDependencyTests-1261716892 None] Acquiring lock "cinder-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec-delete_volume" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:02:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-27914f54-6590-48fd-b59d-aaedec64e8f2 tempest-SnapshotDependencyTests-1261716892 None] Lock "cinder-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:02:03 devstack cinder-volume[82800]: WARNING cinder.volume.volume_utils [None req-27914f54-6590-48fd-b59d-aaedec64e8f2 tempest-SnapshotDependencyTests-1261716892 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 10 16:02:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-27914f54-6590-48fd-b59d-aaedec64e8f2 tempest-SnapshotDependencyTests-1261716892 None] Acquiring lock "cinder-quobyte-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec" by "delete_volume" {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 10 16:02:03 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-27914f54-6590-48fd-b59d-aaedec64e8f2 tempest-SnapshotDependencyTests-1261716892 None] Lock "cinder-quobyte-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec" acquired by "delete_volume" :: waited 0.012s {{(pid=82800) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 10 16:02:04 devstack cinder-volume[82800]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3a76f1-0b0c-4440-8a77-4470aa29bacb]: (4, 'qcow2') {{(pid=84297) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 10 16:02:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-27914f54-6590-48fd-b59d-aaedec64e8f2 tempest-SnapshotDependencyTests-1261716892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:02:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-27914f54-6590-48fd-b59d-aaedec64e8f2 tempest-SnapshotDependencyTests-1261716892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec" returned: 0 in 0.397s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:02:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-27914f54-6590-48fd-b59d-aaedec64e8f2 tempest-SnapshotDependencyTests-1261716892 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:02:04 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-27914f54-6590-48fd-b59d-aaedec64e8f2 tempest-SnapshotDependencyTests-1261716892 None] CMD "rm -f /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf/volume-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec" returned: 0 in 0.092s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:02:04 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-27914f54-6590-48fd-b59d-aaedec64e8f2 tempest-SnapshotDependencyTests-1261716892 None] Lock "cinder-quobyte-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec" released by "delete_volume" :: held 0.649s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:02:04 devstack cinder-volume[82800]: DEBUG cinder.quota [None req-27914f54-6590-48fd-b59d-aaedec64e8f2 tempest-SnapshotDependencyTests-1261716892 None] Created reservations ['4c956b12-7ec9-44f3-83b3-f17057dd6ba1', '104a2373-0656-4df6-bcf7-e78a18cfb236', 'ff379f1f-7b41-4365-88dd-07418d9620d8', '761a3a9f-c8a5-434d-acc6-911d7a16099d'] {{(pid=82800) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 10 16:02:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-27914f54-6590-48fd-b59d-aaedec64e8f2 tempest-SnapshotDependencyTests-1261716892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:02:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-27914f54-6590-48fd-b59d-aaedec64e8f2 tempest-SnapshotDependencyTests-1261716892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:02:05 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-27914f54-6590-48fd-b59d-aaedec64e8f2 tempest-SnapshotDependencyTests-1261716892 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:02:05 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-27914f54-6590-48fd-b59d-aaedec64e8f2 tempest-SnapshotDependencyTests-1261716892 None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:02:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-27914f54-6590-48fd-b59d-aaedec64e8f2 tempest-SnapshotDependencyTests-1261716892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:02:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-27914f54-6590-48fd-b59d-aaedec64e8f2 tempest-SnapshotDependencyTests-1261716892 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:02:05 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-27914f54-6590-48fd-b59d-aaedec64e8f2 tempest-SnapshotDependencyTests-1261716892 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.107s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:02:05 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-27914f54-6590-48fd-b59d-aaedec64e8f2 tempest-SnapshotDependencyTests-1261716892 None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 10 16:02:05 devstack cinder-volume[82800]: INFO cinder.volume.manager [None req-27914f54-6590-48fd-b59d-aaedec64e8f2 tempest-SnapshotDependencyTests-1261716892 None] Deleted volume successfully. Sep 10 16:02:05 devstack cinder-volume[82800]: DEBUG cinder.coordination [None req-27914f54-6590-48fd-b59d-aaedec64e8f2 tempest-SnapshotDependencyTests-1261716892 None] Lock "cinder-6dcfb5c1-1bcd-43c3-87ae-423cf80e6eec-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=82800) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 10 16:02:15 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:UPDATE=105,cinder:SELECT=69,cinder:DELETE=6,cinder:INSERT=18 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 16:02:15 devstack cinder-volume[82800]: DEBUG dbcounter [-] [82800] Writing DB stats cinder:SELECT=72,cinder:INSERT=34,cinder:UPDATE=107,cinder:DELETE=10 {{(pid=82800) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 10 16:02:30 devstack cinder-volume[82800]: DEBUG oslo_service.periodic_task [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82800) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 10 16:02:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 10 16:02:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 10 16:02:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5': None} {{(pid=82800) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 10 16:02:30 devstack cinder-volume[82800]: DEBUG cinder.volume.drivers.quobyte [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Available shares ['10.10.41.181/cinder-vol-45642c4b-ddb4-40a7-96c3-44b14cfaefe5'] {{(pid=82800) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 10 16:02:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.lockutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82800) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 10 16:02:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 10 16:02:30 devstack cinder-volume[82800]: DEBUG oslo_concurrency.processutils [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/8b7b2169e47b66b90bdc7d6a72f49ddf" returned: 0 in 0.096s {{(pid=82800) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 10 16:02:30 devstack cinder-volume[82800]: DEBUG cinder.manager [None req-aa8f45fb-af21-46cd-a1d6-4f00658a11d8 None None] Notifying Schedulers of capabilities ... {{(pid=82800) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}